2023-03-22 17:53:31,542 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-22 17:53:31,804 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371 2023-03-22 17:53:31,818 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-22 17:53:31,818 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8, deleteOnExit=true 2023-03-22 17:53:31,819 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-22 17:53:31,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/test.cache.data in system properties and HBase conf 2023-03-22 17:53:31,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/hadoop.tmp.dir in system properties and HBase conf 2023-03-22 17:53:31,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/hadoop.log.dir in system properties and HBase conf 2023-03-22 17:53:31,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-22 17:53:31,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-22 17:53:31,821 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-22 17:53:31,940 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-22 17:53:32,357 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-22 17:53:32,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-22 17:53:32,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-22 17:53:32,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-22 17:53:32,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-22 17:53:32,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-22 17:53:32,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-22 17:53:32,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-22 17:53:32,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-22 17:53:32,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-22 17:53:32,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/nfs.dump.dir in system properties and HBase conf 2023-03-22 17:53:32,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/java.io.tmpdir in system properties and HBase conf 2023-03-22 17:53:32,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-22 17:53:32,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-22 17:53:32,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-22 17:53:32,956 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-22 17:53:32,960 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-22 17:53:33,260 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-22 17:53:33,441 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-22 17:53:33,467 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-22 17:53:33,508 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-22 17:53:33,540 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/java.io.tmpdir/Jetty_localhost_33351_hdfs____.8gdcpz/webapp 2023-03-22 17:53:33,716 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33351 2023-03-22 17:53:33,727 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-22 17:53:33,727 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-22 17:53:34,177 WARN [Listener at localhost/39935] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-22 17:53:34,334 WARN [Listener at localhost/39935] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-22 17:53:34,358 WARN [Listener at localhost/39935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-22 17:53:34,366 INFO [Listener at localhost/39935] log.Slf4jLog(67): jetty-6.1.26 2023-03-22 17:53:34,372 INFO [Listener at localhost/39935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/java.io.tmpdir/Jetty_localhost_39237_datanode____.ndvsix/webapp 2023-03-22 17:53:34,475 INFO [Listener at localhost/39935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39237 2023-03-22 17:53:34,895 WARN [Listener at localhost/34365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-22 17:53:35,453 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb0aaabedee3b603: Processing first storage report for DS-477aa431-9838-4d3b-9414-3bd42bde2593 from datanode 3abc8896-64a6-46b1-a948-dd067e76a115 2023-03-22 17:53:35,454 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb0aaabedee3b603: from storage DS-477aa431-9838-4d3b-9414-3bd42bde2593 node DatanodeRegistration(127.0.0.1:44747, datanodeUuid=3abc8896-64a6-46b1-a948-dd067e76a115, infoPort=39059, infoSecurePort=0, ipcPort=34365, storageInfo=lv=-57;cid=testClusterID;nsid=496008107;c=1679507613031), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-03-22 17:53:35,454 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb0aaabedee3b603: Processing first storage report for DS-aa41e075-224f-4bba-bb77-31234c9afcf1 from datanode 3abc8896-64a6-46b1-a948-dd067e76a115 2023-03-22 17:53:35,455 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb0aaabedee3b603: from storage DS-aa41e075-224f-4bba-bb77-31234c9afcf1 node DatanodeRegistration(127.0.0.1:44747, datanodeUuid=3abc8896-64a6-46b1-a948-dd067e76a115, infoPort=39059, infoSecurePort=0, ipcPort=34365, storageInfo=lv=-57;cid=testClusterID;nsid=496008107;c=1679507613031), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-22 17:53:35,482 DEBUG [Listener at localhost/34365] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371 2023-03-22 17:53:35,551 INFO [Listener at localhost/34365] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/zookeeper_0, clientPort=60739, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-22 17:53:35,564 INFO [Listener at localhost/34365] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60739 2023-03-22 17:53:35,572 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:35,574 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:36,250 INFO [Listener at localhost/34365] util.FSUtils(471): Created version file at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8 with version=8 2023-03-22 17:53:36,250 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/hbase-staging 2023-03-22 17:53:36,577 INFO [Listener at localhost/34365] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-22 17:53:37,081 INFO [Listener at localhost/34365] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-22 17:53:37,117 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,118 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,118 INFO [Listener at localhost/34365] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-22 17:53:37,118 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,119 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-22 17:53:37,261 INFO [Listener at localhost/34365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-22 17:53:37,337 DEBUG [Listener at localhost/34365] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-22 17:53:37,433 INFO [Listener at localhost/34365] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40261 2023-03-22 17:53:37,443 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:37,445 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:37,465 INFO [Listener at localhost/34365] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40261 connecting to ZooKeeper ensemble=127.0.0.1:60739 2023-03-22 17:53:37,505 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:402610x0, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-22 17:53:37,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40261-0x1010d5c58f70000 connected 2023-03-22 17:53:37,540 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-22 17:53:37,541 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-22 17:53:37,545 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-22 17:53:37,553 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40261 2023-03-22 17:53:37,553 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40261 2023-03-22 17:53:37,554 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40261 2023-03-22 17:53:37,556 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40261 2023-03-22 17:53:37,556 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40261 2023-03-22 17:53:37,562 INFO [Listener at localhost/34365] master.HMaster(444): hbase.rootdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8, hbase.cluster.distributed=false 2023-03-22 17:53:37,636 INFO [Listener at localhost/34365] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-22 17:53:37,636 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,636 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,636 INFO [Listener at localhost/34365] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-22 17:53:37,637 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-22 17:53:37,637 INFO [Listener at localhost/34365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-22 17:53:37,642 INFO [Listener at localhost/34365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-22 17:53:37,644 INFO [Listener at localhost/34365] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46619 2023-03-22 17:53:37,647 INFO [Listener at localhost/34365] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-22 17:53:37,653 DEBUG [Listener at localhost/34365] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-22 17:53:37,654 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:37,657 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:37,659 INFO [Listener at localhost/34365] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46619 connecting to ZooKeeper ensemble=127.0.0.1:60739 2023-03-22 17:53:37,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:466190x0, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-22 17:53:37,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46619-0x1010d5c58f70001 connected 2023-03-22 17:53:37,665 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-22 17:53:37,666 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-22 17:53:37,667 DEBUG [Listener at localhost/34365] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-22 17:53:37,668 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46619 2023-03-22 17:53:37,669 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46619 2023-03-22 17:53:37,669 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46619 2023-03-22 17:53:37,670 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46619 2023-03-22 17:53:37,670 DEBUG [Listener at localhost/34365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46619 2023-03-22 17:53:37,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:37,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-22 17:53:37,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:37,704 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-22 17:53:37,704 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-22 17:53:37,704 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:37,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-22 17:53:37,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40261,1679507616391 from backup master directory 2023-03-22 17:53:37,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-22 17:53:37,711 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:37,711 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-22 17:53:37,711 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-22 17:53:37,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:37,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-22 17:53:37,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-22 17:53:37,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/hbase.id with ID: a10dec73-07e5-4315-9422-fdbb2344e9da 2023-03-22 17:53:37,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:37,869 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:38,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x222930dc to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:38,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5169f747, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:38,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-22 17:53:38,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-22 17:53:38,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-22 17:53:38,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-22 17:53:38,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-22 17:53:38,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-22 17:53:38,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-22 17:53:38,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store-tmp 2023-03-22 17:53:38,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:38,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-22 17:53:38,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:53:38,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:53:38,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-22 17:53:38,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:53:38,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:53:38,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-22 17:53:38,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/WALs/jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:38,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40261%2C1679507616391, suffix=, logDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/WALs/jenkins-hbase4.apache.org,40261,1679507616391, archiveDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/oldWALs, maxLogs=10 2023-03-22 17:53:38,517 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK] 2023-03-22 17:53:38,525 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-22 17:53:38,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/WALs/jenkins-hbase4.apache.org,40261,1679507616391/jenkins-hbase4.apache.org%2C40261%2C1679507616391.1679507618476 2023-03-22 17:53:38,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK]] 2023-03-22 17:53:38,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:38,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:38,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,671 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,680 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-22 17:53:38,703 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-22 17:53:38,715 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:38,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-22 17:53:38,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:53:38,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68847279, jitterRate=0.025904402136802673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:53:38,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-22 17:53:38,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-22 17:53:38,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-22 17:53:38,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-22 17:53:38,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-22 17:53:38,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-22 17:53:38,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-03-22 17:53:38,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-22 17:53:38,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-22 17:53:38,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-22 17:53:38,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-22 17:53:38,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-22 17:53:38,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-22 17:53:38,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-22 17:53:38,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-22 17:53:38,905 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:38,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-22 17:53:38,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-22 17:53:38,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-22 17:53:38,930 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-22 17:53:38,930 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-22 17:53:38,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:38,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40261,1679507616391, sessionid=0x1010d5c58f70000, setting cluster-up flag (Was=false) 2023-03-22 17:53:38,950 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:38,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-22 17:53:38,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:38,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:38,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-22 17:53:38,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:38,975 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp 2023-03-22 17:53:39,080 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(952): ClusterId : a10dec73-07e5-4315-9422-fdbb2344e9da 2023-03-22 17:53:39,086 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-22 17:53:39,097 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-22 17:53:39,097 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-22 17:53:39,105 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-22 17:53:39,106 DEBUG [RS:0;jenkins-hbase4:46619] zookeeper.ReadOnlyZKClient(139): Connect 0x4ff98d89 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:39,121 DEBUG [RS:0;jenkins-hbase4:46619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@413e6a06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:39,122 DEBUG [RS:0;jenkins-hbase4:46619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4501e6f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-22 17:53:39,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-22 17:53:39,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-22 17:53:39,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,158 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46619 2023-03-22 17:53:39,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1679507649163 2023-03-22 17:53:39,164 INFO [RS:0;jenkins-hbase4:46619] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-22 17:53:39,164 INFO [RS:0;jenkins-hbase4:46619] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-22 17:53:39,164 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1023): About to register with Master. 2023-03-22 17:53:39,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-22 17:53:39,170 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40261,1679507616391 with isa=jenkins-hbase4.apache.org/172.31.14.131:46619, startcode=1679507617635 2023-03-22 17:53:39,170 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-22 17:53:39,171 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-22 17:53:39,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-22 17:53:39,179 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-22 17:53:39,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-22 17:53:39,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-22 17:53:39,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-22 17:53:39,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-22 17:53:39,192 DEBUG [RS:0;jenkins-hbase4:46619] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-22 17:53:39,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-22 17:53:39,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-22 17:53:39,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-22 17:53:39,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-22 17:53:39,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-22 17:53:39,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679507619205,5,FailOnTimeoutGroup] 2023-03-22 17:53:39,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679507619206,5,FailOnTimeoutGroup] 2023-03-22 17:53:39,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-22 17:53:39,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,259 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55043, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-22 17:53:39,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,288 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8 2023-03-22 17:53:39,288 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39935 2023-03-22 17:53:39,288 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-22 17:53:39,293 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-22 17:53:39,293 DEBUG [RS:0;jenkins-hbase4:46619] zookeeper.ZKUtil(162): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,293 WARN [RS:0;jenkins-hbase4:46619] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-22 17:53:39,294 INFO [RS:0;jenkins-hbase4:46619] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-22 17:53:39,294 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,296 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46619,1679507617635] 2023-03-22 17:53:39,303 DEBUG [RS:0;jenkins-hbase4:46619] zookeeper.ZKUtil(162): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,312 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-22 17:53:39,320 INFO [RS:0;jenkins-hbase4:46619] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-22 17:53:39,338 INFO [RS:0;jenkins-hbase4:46619] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-22 17:53:39,341 INFO [RS:0;jenkins-hbase4:46619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:53:39,342 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,343 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-22 17:53:39,349 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,349 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-22 17:53:39,350 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,351 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,351 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,351 DEBUG [RS:0;jenkins-hbase4:46619] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-22 17:53:39,352 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,352 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,352 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,368 INFO [RS:0;jenkins-hbase4:46619] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-22 17:53:39,370 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46619,1679507617635-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:39,390 INFO [RS:0;jenkins-hbase4:46619] regionserver.Replication(203): jenkins-hbase4.apache.org,46619,1679507617635 started 2023-03-22 17:53:39,390 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46619,1679507617635, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46619, sessionid=0x1010d5c58f70001 2023-03-22 17:53:39,390 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-22 17:53:39,390 DEBUG [RS:0;jenkins-hbase4:46619] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,390 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46619,1679507617635' 2023-03-22 17:53:39,391 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:39,391 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:39,392 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-22 17:53:39,392 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-22 17:53:39,392 DEBUG [RS:0;jenkins-hbase4:46619] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:39,392 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46619,1679507617635' 2023-03-22 17:53:39,392 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-22 17:53:39,393 DEBUG [RS:0;jenkins-hbase4:46619] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-22 17:53:39,393 DEBUG [RS:0;jenkins-hbase4:46619] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-22 17:53:39,393 INFO [RS:0;jenkins-hbase4:46619] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-22 17:53:39,393 INFO [RS:0;jenkins-hbase4:46619] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-22 17:53:39,504 INFO [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46619%2C1679507617635, suffix=, logDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635, archiveDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/oldWALs, maxLogs=32 2023-03-22 17:53:39,522 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK] 2023-03-22 17:53:39,525 INFO [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635/jenkins-hbase4.apache.org%2C46619%2C1679507617635.1679507619506 2023-03-22 17:53:39,525 DEBUG [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK]] 2023-03-22 17:53:39,622 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:39,623 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:39,624 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8 2023-03-22 17:53:39,637 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:39,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-22 17:53:39,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/info 2023-03-22 17:53:39,643 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-22 17:53:39,644 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:39,644 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-22 17:53:39,647 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/rep_barrier 2023-03-22 17:53:39,648 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-22 17:53:39,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:39,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-22 17:53:39,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/table 2023-03-22 17:53:39,652 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-22 17:53:39,652 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:39,654 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740 2023-03-22 17:53:39,655 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740 2023-03-22 17:53:39,658 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-22 17:53:39,660 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-22 17:53:39,663 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:53:39,664 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62226639, jitterRate=-0.07275082170963287}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-22 17:53:39,664 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-22 17:53:39,664 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-22 17:53:39,664 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-22 17:53:39,665 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-22 17:53:39,665 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-22 17:53:39,665 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-22 17:53:39,666 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-22 17:53:39,666 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-22 17:53:39,671 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-22 17:53:39,671 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-22 17:53:39,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-22 17:53:39,692 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-22 17:53:39,694 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-22 17:53:39,846 DEBUG [jenkins-hbase4:40261] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-22 17:53:39,850 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46619,1679507617635, state=OPENING 2023-03-22 17:53:39,857 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-22 17:53:39,860 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:39,861 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-22 17:53:39,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:40,047 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:40,050 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-22 17:53:40,053 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-22 17:53:40,064 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-22 17:53:40,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-22 17:53:40,068 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46619%2C1679507617635.meta, suffix=.meta, logDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635, archiveDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/oldWALs, maxLogs=32 2023-03-22 17:53:40,087 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK] 2023-03-22 17:53:40,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635/jenkins-hbase4.apache.org%2C46619%2C1679507617635.meta.1679507620070.meta 2023-03-22 17:53:40,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK]] 2023-03-22 17:53:40,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:40,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-22 17:53:40,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-22 17:53:40,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-22 17:53:40,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-22 17:53:40,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:40,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-22 17:53:40,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-22 17:53:40,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-22 17:53:40,126 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/info 2023-03-22 17:53:40,127 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/info 2023-03-22 17:53:40,127 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-22 17:53:40,128 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:40,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-22 17:53:40,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/rep_barrier 2023-03-22 17:53:40,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/rep_barrier 2023-03-22 17:53:40,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-22 17:53:40,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:40,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-22 17:53:40,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/table 2023-03-22 17:53:40,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/table 2023-03-22 17:53:40,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-22 17:53:40,135 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:40,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740 2023-03-22 17:53:40,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740 2023-03-22 17:53:40,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-22 17:53:40,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-22 17:53:40,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65141190, jitterRate=-0.029320627450942993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-22 17:53:40,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-22 17:53:40,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1679507620040 2023-03-22 17:53:40,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-22 17:53:40,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-22 17:53:40,180 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46619,1679507617635, state=OPEN 2023-03-22 17:53:40,183 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-22 17:53:40,183 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-22 17:53:40,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-22 17:53:40,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46619,1679507617635 in 319 msec 2023-03-22 17:53:40,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-22 17:53:40,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 509 msec 2023-03-22 17:53:40,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1550 sec 2023-03-22 17:53:40,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1679507620197, completionTime=-1 2023-03-22 17:53:40,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-22 17:53:40,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-22 17:53:40,273 DEBUG [hconnection-0x4d98dc23-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:40,276 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:40,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-22 17:53:40,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1679507680295 2023-03-22 17:53:40,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1679507740295 2023-03-22 17:53:40,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-03-22 17:53:40,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40261,1679507616391-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:40,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40261,1679507616391-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:40,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40261,1679507616391-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:40,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40261, period=300000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:40,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-22 17:53:40,326 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-22 17:53:40,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-22 17:53:40,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-22 17:53:40,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-22 17:53:40,349 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:53:40,351 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:53:40,376 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:40,379 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60 empty. 2023-03-22 17:53:40,380 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:40,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-22 17:53:40,806 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:40,808 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8bfb56d80101d7d405037a15c1758d60, NAME => 'hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:53:40,819 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:40,819 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8bfb56d80101d7d405037a15c1758d60, disabling compactions & flushes 2023-03-22 17:53:40,819 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:40,819 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:40,819 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. after waiting 0 ms 2023-03-22 17:53:40,820 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:40,820 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:40,820 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8bfb56d80101d7d405037a15c1758d60: 2023-03-22 17:53:40,824 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:53:40,839 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679507620827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507620827"}]},"ts":"1679507620827"} 2023-03-22 17:53:40,869 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:53:40,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:53:40,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507620871"}]},"ts":"1679507620871"} 2023-03-22 17:53:40,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-22 17:53:40,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8bfb56d80101d7d405037a15c1758d60, ASSIGN}] 2023-03-22 17:53:40,893 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8bfb56d80101d7d405037a15c1758d60, ASSIGN 2023-03-22 17:53:40,895 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8bfb56d80101d7d405037a15c1758d60, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:53:41,046 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8bfb56d80101d7d405037a15c1758d60, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:41,046 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679507621045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507621045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507621045"}]},"ts":"1679507621045"} 2023-03-22 17:53:41,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8bfb56d80101d7d405037a15c1758d60, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:41,212 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:41,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8bfb56d80101d7d405037a15c1758d60, NAME => 'hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:41,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:41,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,216 INFO [StoreOpener-8bfb56d80101d7d405037a15c1758d60-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,218 DEBUG [StoreOpener-8bfb56d80101d7d405037a15c1758d60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/info 2023-03-22 17:53:41,218 DEBUG [StoreOpener-8bfb56d80101d7d405037a15c1758d60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/info 2023-03-22 17:53:41,218 INFO [StoreOpener-8bfb56d80101d7d405037a15c1758d60-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bfb56d80101d7d405037a15c1758d60 columnFamilyName info 2023-03-22 17:53:41,219 INFO [StoreOpener-8bfb56d80101d7d405037a15c1758d60-1] regionserver.HStore(310): Store=8bfb56d80101d7d405037a15c1758d60/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:41,221 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:53:41,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:53:41,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8bfb56d80101d7d405037a15c1758d60; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60914950, jitterRate=-0.09229651093482971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:53:41,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8bfb56d80101d7d405037a15c1758d60: 2023-03-22 17:53:41,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60., pid=6, masterSystemTime=1679507621204 2023-03-22 17:53:41,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:41,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:53:41,237 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8bfb56d80101d7d405037a15c1758d60, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:41,238 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679507621237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507621237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507621237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507621237"}]},"ts":"1679507621237"} 2023-03-22 17:53:41,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-22 17:53:41,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8bfb56d80101d7d405037a15c1758d60, server=jenkins-hbase4.apache.org,46619,1679507617635 in 190 msec 2023-03-22 17:53:41,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-22 17:53:41,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8bfb56d80101d7d405037a15c1758d60, ASSIGN in 356 msec 2023-03-22 17:53:41,249 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:53:41,250 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507621250"}]},"ts":"1679507621250"} 2023-03-22 17:53:41,253 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-22 17:53:41,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:53:41,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 919 msec 2023-03-22 17:53:41,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-22 17:53:41,351 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-22 17:53:41,351 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:53:41,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-22 17:53:41,419 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-22 17:53:41,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-03-22 17:53:41,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-22 17:53:41,447 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-22 17:53:41,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-03-22 17:53:41,460 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-22 17:53:41,469 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-22 17:53:41,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.757sec 2023-03-22 17:53:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-22 17:53:41,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-22 17:53:41,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-22 17:53:41,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40261,1679507616391-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-22 17:53:41,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40261,1679507616391-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-22 17:53:41,515 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(139): Connect 0x561bf69b to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:41,520 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f0808a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:41,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-22 17:53:41,533 DEBUG [hconnection-0xcc760f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:41,549 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:41,560 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:53:41,561 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(139): Connect 0x6b586bb5 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:41,568 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d78ff9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:41,569 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:53:41,592 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=169, AvailableMemoryMB=6718 2023-03-22 17:53:41,605 DEBUG [Listener at localhost/34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:53:41,608 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39234, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:53:41,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:53:41,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:41,624 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:53:41,626 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:53:41,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-22 17:53:41,629 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:41,630 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f empty. 2023-03-22 17:53:41,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:41,632 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-22 17:53:41,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:41,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:41,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:42,048 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:42,051 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6aab306289443dd1ebc37d2169a12d8f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:53:42,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:42,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:42,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 6aab306289443dd1ebc37d2169a12d8f, disabling compactions & flushes 2023-03-22 17:53:42,464 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. after waiting 0 ms 2023-03-22 17:53:42,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,464 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:42,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:53:42,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507622470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507622470"}]},"ts":"1679507622470"} 2023-03-22 17:53:42,473 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:53:42,474 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:53:42,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507622474"}]},"ts":"1679507622474"} 2023-03-22 17:53:42,477 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-22 17:53:42,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, ASSIGN}] 2023-03-22 17:53:42,484 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, ASSIGN 2023-03-22 17:53:42,485 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:53:42,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:42,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507622636"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507622636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507622636"}]},"ts":"1679507622636"} 2023-03-22 17:53:42,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:42,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:42,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aab306289443dd1ebc37d2169a12d8f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:42,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:42,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,805 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,807 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:42,807 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:42,810 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aab306289443dd1ebc37d2169a12d8f columnFamilyName family1 2023-03-22 17:53:42,812 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(310): Store=6aab306289443dd1ebc37d2169a12d8f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:42,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:42,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:53:42,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6aab306289443dd1ebc37d2169a12d8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72451166, jitterRate=0.07960650324821472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:53:42,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:42,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., pid=11, masterSystemTime=1679507622794 2023-03-22 17:53:42,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:42,829 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:42,830 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507622829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507622829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507622829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507622829"}]},"ts":"1679507622829"} 2023-03-22 17:53:42,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-22 17:53:42,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635 in 192 msec 2023-03-22 17:53:42,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-22 17:53:42,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, ASSIGN in 355 msec 2023-03-22 17:53:42,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:53:42,841 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507622841"}]},"ts":"1679507622841"} 2023-03-22 17:53:42,844 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-22 17:53:42,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:53:42,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2340 sec 2023-03-22 17:53:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-22 17:53:43,750 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-22 17:53:43,769 DEBUG [hconnection-0x7aa6bd5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:43,773 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44550, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:43,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:43,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:43,999 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:43,999 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:44,001 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:44,002 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:44,003 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,003 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,006 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:44,006 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:44,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,011 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,013 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:44,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:44,033 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:44,048 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:44,049 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:44,051 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:53:44,336 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f5ab5d4aab7b4536a8c14193bc01078f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f5ab5d4aab7b4536a8c14193bc01078f 2023-03-22 17:53:44,771 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/23a67596e45b4789a567fc22ecfaf3b9 2023-03-22 17:53:44,784 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/23a67596e45b4789a567fc22ecfaf3b9 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9 2023-03-22 17:53:44,796 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-22 17:53:44,800 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 749ms, sequenceid=5, compaction requested=false 2023-03-22 17:53:44,802 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:44,806 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:44,806 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:44,806 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:44,806 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:44,807 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:44,810 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:44,813 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a898db[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:44,813 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,816 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,816 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:44,822 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,822 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:44,823 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:44,823 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:44,826 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,826 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:44,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:44,827 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:44,827 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:44,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:44,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:44,833 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:44,833 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:44,833 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:44,833 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,833 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:44,836 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,837 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:44,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:44,837 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,838 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,841 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,853 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:44,853 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:44,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:44,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:44,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:44,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,858 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,858 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,858 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,858 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,858 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,858 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:44,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:44,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:44,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:44,865 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:44,865 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:44,966 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:44,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:44,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:44,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:44,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,992 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:44,992 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:44,993 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:44,993 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:44,994 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,994 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,996 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:44,996 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:44,997 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:44,997 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:44,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,012 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:45,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:45,028 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:45,028 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:45,028 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:53:45,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b07c81292f55474f9e25377636347141 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128b07c81292f55474f9e25377636347141 2023-03-22 17:53:45,172 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/8b59f2999c4c43468dd2be1463cf4013 2023-03-22 17:53:45,195 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/8b59f2999c4c43468dd2be1463cf4013 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013 2023-03-22 17:53:45,207 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:53:45,209 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 181ms, sequenceid=9, compaction requested=false 2023-03-22 17:53:45,209 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:45,209 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:45,209 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:45,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:45,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:45,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:45,212 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,212 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:45,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3910ddff[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:45,215 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:45,215 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,217 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,217 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:45,217 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:45,217 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:45,218 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,218 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:45,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:45,222 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:45,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:45,228 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:45,228 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:45,228 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:45,228 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,229 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:45,237 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,237 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,238 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:45,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:45,239 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,242 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:45,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:45,246 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:45,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:45,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:45,248 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:45,248 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:45,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:45,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:45,348 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:45,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:45,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:45,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:45,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,366 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:45,366 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:45,367 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:45,367 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:45,367 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,367 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,369 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,369 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:45,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:45,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:45,370 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,370 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:45,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:45,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:45,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,377 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:45,377 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:45,378 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:45,379 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:45,379 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:45,440 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010a08eddcb9474d4e89523458226c350d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010a08eddcb9474d4e89523458226c350d 2023-03-22 17:53:45,469 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/04e7d29dddfa4046b3948737844b8f7b 2023-03-22 17:53:45,480 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/04e7d29dddfa4046b3948737844b8f7b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b 2023-03-22 17:53:45,489 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b, entries=1, sequenceid=13, filesize=5.0 K 2023-03-22 17:53:45,491 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 112ms, sequenceid=13, compaction requested=true 2023-03-22 17:53:45,491 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:45,492 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,496 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e9f6675[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:45,499 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:45,500 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,502 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:45,503 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,503 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:45,510 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,511 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:45,511 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:45,511 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:45,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:45,516 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:45,516 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:45,516 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:45,516 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,517 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:45,528 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:45,528 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,529 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:45,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:45,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:45,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:45,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:45,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:45,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,533 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:45,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:45,538 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:45,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:45,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:45,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:45,538 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:45,540 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:45,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:45,540 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:45,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:45,640 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:45,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:45,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,676 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:45,676 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:45,688 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:45,689 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:45,689 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,689 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,691 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:45,691 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:45,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:45,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:53:45,692 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:45,692 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:45,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,695 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:45,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:45,695 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:45,695 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:45,704 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:45,708 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:45,708 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:45,709 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:45,709 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:45,831 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056c09d7fb039a4201a65fd4db9104c6f4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056c09d7fb039a4201a65fd4db9104c6f4 2023-03-22 17:53:45,848 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-22 17:53:45,850 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-22 17:53:46,261 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f 2023-03-22 17:53:46,275 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f 2023-03-22 17:53:46,291 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f, entries=1, sequenceid=17, filesize=5.0 K 2023-03-22 17:53:46,293 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 584ms, sequenceid=17, compaction requested=true 2023-03-22 17:53:46,293 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:46,293 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:46,293 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:46,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f3d9521[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:46,302 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:46,302 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,304 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,304 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:46,308 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:46,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:46,318 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,319 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:46,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:46,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:46,323 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:46,323 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:46,323 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:46,323 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,323 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:46,326 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,326 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,326 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,327 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,330 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,344 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:46,344 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:46,345 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:46,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:46,345 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,345 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,346 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,346 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,346 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,346 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,346 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,344 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:46,347 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:46,347 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:46,447 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:46,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:46,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:46,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:46,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,476 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:46,476 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:46,477 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:46,477 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:46,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,480 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:46,480 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:46,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:46,481 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,481 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:46,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:46,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,486 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:46,486 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:46,488 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:46,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:46,492 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:46,492 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:46,492 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:46,492 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:46,571 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-22 17:53:46,571 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-22 17:53:46,579 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289baf2d6f3fab4eaaa2a5de07a1716ca8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289baf2d6f3fab4eaaa2a5de07a1716ca8 2023-03-22 17:53:46,610 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/f7a42c19742b45f8b973835971eccc5f 2023-03-22 17:53:46,629 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/f7a42c19742b45f8b973835971eccc5f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f 2023-03-22 17:53:46,648 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f, entries=1, sequenceid=21, filesize=5.0 K 2023-03-22 17:53:46,649 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 157ms, sequenceid=21, compaction requested=true 2023-03-22 17:53:46,649 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:46,650 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:46,650 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:46,650 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:46,650 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,650 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,656 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,657 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5814a85d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:46,660 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:46,660 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,662 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,662 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:46,662 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:46,662 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:46,662 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,662 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,666 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:46,667 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:46,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:46,675 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:46,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:46,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:46,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,675 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:46,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,683 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,687 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,695 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:46,695 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,695 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:46,695 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,696 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:46,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:46,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:46,697 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:46,697 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:46,797 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:46,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:46,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:46,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:46,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,828 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:46,828 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:46,829 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:46,829 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:46,829 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,829 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,831 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,831 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:46,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:46,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:46,832 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,832 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:46,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,833 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:46,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,834 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:46,834 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:46,844 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:46,844 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:46,844 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:46,874 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123119b17b105ae34b94b3356497184e61a6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123119b17b105ae34b94b3356497184e61a6 2023-03-22 17:53:46,893 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/32fa2c8848bf44a5a64a2081b78d7c5b 2023-03-22 17:53:46,916 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/32fa2c8848bf44a5a64a2081b78d7c5b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b 2023-03-22 17:53:46,930 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b, entries=1, sequenceid=25, filesize=5.0 K 2023-03-22 17:53:46,931 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 87ms, sequenceid=25, compaction requested=true 2023-03-22 17:53:46,931 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:46,931 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:46,932 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:46,932 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:46,932 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,933 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:46,933 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:46,935 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:46,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:46,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67546985[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:46,942 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:46,942 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,945 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,946 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,946 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:46,946 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:46,946 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:46,946 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:46,948 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,949 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:46,949 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,949 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:46,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:46,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:46,953 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:46,953 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:46,953 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:46,953 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,953 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:46,955 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,955 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,956 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:46,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:46,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:46,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:46,957 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:46,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,959 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:46,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,962 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:46,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:46,963 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:46,963 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:46,963 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:46,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:46,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:46,963 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:46,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:46,965 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:46,965 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:46,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:47,065 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:47,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:47,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:47,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,088 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:47,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:47,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:47,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:47,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,093 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:47,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:47,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,094 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:47,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,094 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,097 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:47,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:47,101 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:47,104 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:47,104 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:47,104 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:47,104 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:47,158 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016dea37af78db4ceaa518dc92c11073bd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016dea37af78db4ceaa518dc92c11073bd 2023-03-22 17:53:47,208 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6 2023-03-22 17:53:47,218 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6 2023-03-22 17:53:47,231 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6, entries=1, sequenceid=29, filesize=5.0 K 2023-03-22 17:53:47,233 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 129ms, sequenceid=29, compaction requested=true 2023-03-22 17:53:47,233 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:47,234 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:47,237 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,237 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,238 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,238 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:47,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627d07d4[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:47,241 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:47,242 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,243 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,243 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:47,243 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:47,243 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:47,244 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,244 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:47,245 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,245 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:47,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:47,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:47,250 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:47,250 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:47,250 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:47,250 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,251 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:47,254 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,254 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:47,254 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:47,255 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,260 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:47,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:47,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:47,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:47,270 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:47,270 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:47,268 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:47,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:47,370 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:47,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:47,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:47,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,388 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:47,388 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:47,389 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:47,389 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:47,390 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,390 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,391 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:47,391 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,392 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,392 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:47,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:47,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:47,396 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:47,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:47,405 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:47,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:47,405 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:47,405 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:47,480 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034558f92b934e42e9bbecdb29e28047a5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601034558f92b934e42e9bbecdb29e28047a5 2023-03-22 17:53:47,903 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/e595238f2ed84526883e84318f0bf592 2023-03-22 17:53:47,914 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/e595238f2ed84526883e84318f0bf592 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592 2023-03-22 17:53:47,926 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592, entries=1, sequenceid=33, filesize=5.0 K 2023-03-22 17:53:47,927 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 522ms, sequenceid=33, compaction requested=true 2023-03-22 17:53:47,928 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:47,928 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:47,928 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:47,928 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:47,929 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,929 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:47,929 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:47,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@119a1227[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:47,934 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:47,935 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,936 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:47,936 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,936 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:47,939 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:47,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:47,948 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:47,948 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:47,948 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:47,948 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,948 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:47,950 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,951 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:47,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,951 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,953 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:47,954 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,957 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:47,957 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:47,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:47,957 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:47,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:47,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:47,958 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:47,958 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:47,958 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,958 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:47,958 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,959 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:47,959 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,959 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,959 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:47,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:48,059 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:48,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:48,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:48,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:48,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,071 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:48,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:48,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:48,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:48,072 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,072 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,074 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:48,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:48,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:48,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,076 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:48,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,078 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:48,078 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:48,079 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:48,079 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:48,079 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:48,079 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:48,079 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:48,079 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:48,116 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090799b789de2bcf4a3197f9df939f6b8d31 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090799b789de2bcf4a3197f9df939f6b8d31 2023-03-22 17:53:48,549 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc 2023-03-22 17:53:48,567 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc 2023-03-22 17:53:48,576 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc, entries=1, sequenceid=37, filesize=5.0 K 2023-03-22 17:53:48,577 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 498ms, sequenceid=37, compaction requested=true 2023-03-22 17:53:48,578 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:48,578 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:48,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:48,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:48,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:48,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:48,581 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:48,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:48,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:48,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:48,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:48,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cb11609[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:48,585 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:48,585 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,586 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,586 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:48,586 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:48,586 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:48,587 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,587 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:48,588 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:48,588 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:48,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:48,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:48,592 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:48,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:48,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:48,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,592 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:48,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:48,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:48,596 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:48,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,599 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:48,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:48,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:48,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:48,603 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:48,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:48,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:48,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:48,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:48,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:48,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,704 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:48,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:48,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:48,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:48,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,716 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:48,717 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:48,717 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-22 17:53:48,717 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-22 17:53:48,718 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,718 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,719 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,719 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:48,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:48,720 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:48,720 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-22 17:53:48,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:48,721 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-22 17:53:48,721 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:48,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-22 17:53:48,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:48,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:48,723 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:48,723 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. started... 2023-03-22 17:53:48,723 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aab306289443dd1ebc37d2169a12d8f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:48,760 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203009bafb45e541bc9fecfdcdea67ce9e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203009bafb45e541bc9fecfdcdea67ce9e 2023-03-22 17:53:49,180 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/74ca83010e39413da9c14e3bc0278e4c 2023-03-22 17:53:49,195 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/74ca83010e39413da9c14e3bc0278e4c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c 2023-03-22 17:53:49,203 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c, entries=1, sequenceid=41, filesize=5.0 K 2023-03-22 17:53:49,205 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6aab306289443dd1ebc37d2169a12d8f in 482ms, sequenceid=41, compaction requested=true 2023-03-22 17:53:49,205 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:49,205 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-22 17:53:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-22 17:53:49,209 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,209 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:49,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-22 17:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286d525b[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:49,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-22 17:53:49,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,216 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-22 17:53:49,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-22 17:53:49,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:49,216 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,216 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:49,220 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,220 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-22 17:53:49,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:49,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:49,221 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:49,221 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-22 17:53:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:49,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:49,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:49,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-22 17:53:49,231 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-22 17:53:49,231 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:49,231 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:49,231 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,231 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:49,233 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,233 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:49,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,234 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:49,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:49,236 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,240 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,243 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:49,243 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:49,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-22 17:53:49,244 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:49,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-22 17:53:49,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,244 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:49,245 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:49,245 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:49,345 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:49,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:49,353 DEBUG [Listener at localhost/34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-22 17:53:49,355 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-22 17:53:49,357 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:49,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:49,374 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:49,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:53:49,375 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508229375 2023-03-22 17:53:49,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:53:49,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-22 17:53:49,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:49,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x483e0a19 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:49,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e3018b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:49,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:49,901 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ac60f28dd9f74fdeaf5f026902279e1e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac60f28dd9f74fdeaf5f026902279e1e 2023-03-22 17:53:49,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:49,931 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:49,933 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44558, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:49,946 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:53:49,948 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45262, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:53:49,996 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec61bd2b1f984175a52008f8218fe0f6 first=Optional[r3] last=Optional[r6] 2023-03-22 17:53:50,013 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec61bd2b1f984175a52008f8218fe0f6}] 2023-03-22 17:53:50,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec61bd2b1f984175a52008f8218fe0f6 for inclusion in 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:50,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-22 17:53:50,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:53:50,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:50,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec61bd2b1f984175a52008f8218fe0f6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g7e11po6ft91gi4pd2ph8j79uo9g8fftc4g78pnqij6ncidm8vod9pnnvagiaqei/family1/ec61bd2b1f984175a52008f8218fe0f6 2023-03-22 17:53:50,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g7e11po6ft91gi4pd2ph8j79uo9g8fftc4g78pnqij6ncidm8vod9pnnvagiaqei/family1/ec61bd2b1f984175a52008f8218fe0f6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_ 2023-03-22 17:53:50,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g7e11po6ft91gi4pd2ph8j79uo9g8fftc4g78pnqij6ncidm8vod9pnnvagiaqei/family1/ec61bd2b1f984175a52008f8218fe0f6 into 6aab306289443dd1ebc37d2169a12d8f/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_ - updating store file list. 2023-03-22 17:53:50,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_ into 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:50,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g7e11po6ft91gi4pd2ph8j79uo9g8fftc4g78pnqij6ncidm8vod9pnnvagiaqei/family1/ec61bd2b1f984175a52008f8218fe0f6 into 6aab306289443dd1ebc37d2169a12d8f/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_) 2023-03-22 17:53:50,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g7e11po6ft91gi4pd2ph8j79uo9g8fftc4g78pnqij6ncidm8vod9pnnvagiaqei/family1/ec61bd2b1f984175a52008f8218fe0f6 2023-03-22 17:53:50,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:53:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:53:50,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 6aab306289443dd1ebc37d2169a12d8f/family1 is initiating minor compaction 2023-03-22 17:53:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fda948d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:53:50,091 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6aab306289443dd1ebc37d2169a12d8f/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:50,092 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp, totalSize=50.2 K 2023-03-22 17:53:50,092 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 8b59f2999c4c43468dd2be1463cf4013, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 04e7d29dddfa4046b3948737844b8f7b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting bf1b48ad921e4a7cbb6f68f7c2c2735f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting f7a42c19742b45f8b973835971eccc5f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 32fa2c8848bf44a5a64a2081b78d7c5b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting bcbb1b92bccf4c8fb013c9cd701dc7a6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting e595238f2ed84526883e84318f0bf592, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting d5a1988f25bc4a0fbf0cc55c6bac56fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 74ca83010e39413da9c14e3bc0278e4c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:53:50,093 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 823988c7f0224a5394d945e534ffe8f9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:53:50,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:50,106 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:50,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289baf2d6f3fab4eaaa2a5de07a1716ca8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289baf2d6f3fab4eaaa2a5de07a1716ca8 2023-03-22 17:53:50,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123119b17b105ae34b94b3356497184e61a6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123119b17b105ae34b94b3356497184e61a6 2023-03-22 17:53:50,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016dea37af78db4ceaa518dc92c11073bd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016dea37af78db4ceaa518dc92c11073bd 2023-03-22 17:53:50,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601034558f92b934e42e9bbecdb29e28047a5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601034558f92b934e42e9bbecdb29e28047a5 2023-03-22 17:53:50,123 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-22 17:53:50,123 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-22 17:53:50,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,187 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6aab306289443dd1ebc37d2169a12d8f#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:53:50,337 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120563a96f0f09f347a6884570399fe3ee8a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120563a96f0f09f347a6884570399fe3ee8a 2023-03-22 17:53:50,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:50,413 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/781dae2c85b24ab0b2ba9a0987fee17e first=Optional[r00] last=Optional[r2] 2023-03-22 17:53:50,416 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/781dae2c85b24ab0b2ba9a0987fee17e}] 2023-03-22 17:53:50,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/781dae2c85b24ab0b2ba9a0987fee17e for inclusion in 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-22 17:53:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:53:50,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/781dae2c85b24ab0b2ba9a0987fee17e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tmtpb2sd1mv3heuma0ile9bal50514r9jo4ko08h2iukteij81uqfjfe6vakln3/family1/781dae2c85b24ab0b2ba9a0987fee17e 2023-03-22 17:53:50,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tmtpb2sd1mv3heuma0ile9bal50514r9jo4ko08h2iukteij81uqfjfe6vakln3/family1/781dae2c85b24ab0b2ba9a0987fee17e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ 2023-03-22 17:53:50,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tmtpb2sd1mv3heuma0ile9bal50514r9jo4ko08h2iukteij81uqfjfe6vakln3/family1/781dae2c85b24ab0b2ba9a0987fee17e into 6aab306289443dd1ebc37d2169a12d8f/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ - updating store file list. 2023-03-22 17:53:50,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ into 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:50,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tmtpb2sd1mv3heuma0ile9bal50514r9jo4ko08h2iukteij81uqfjfe6vakln3/family1/781dae2c85b24ab0b2ba9a0987fee17e into 6aab306289443dd1ebc37d2169a12d8f/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_) 2023-03-22 17:53:50,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tmtpb2sd1mv3heuma0ile9bal50514r9jo4ko08h2iukteij81uqfjfe6vakln3/family1/781dae2c85b24ab0b2ba9a0987fee17e 2023-03-22 17:53:50,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:50,448 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:50,451 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f5ab5d4aab7b4536a8c14193bc01078f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f5ab5d4aab7b4536a8c14193bc01078f 2023-03-22 17:53:50,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010a08eddcb9474d4e89523458226c350d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010a08eddcb9474d4e89523458226c350d 2023-03-22 17:53:50,456 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056c09d7fb039a4201a65fd4db9104c6f4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056c09d7fb039a4201a65fd4db9104c6f4 2023-03-22 17:53:50,456 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-22 17:53:50,456 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-22 17:53:50,459 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:50,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:50,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:53:50,461 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:50,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.0970 sec 2023-03-22 17:53:50,660 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/2845c90953204b20b1b27989cf1b5f9c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c 2023-03-22 17:53:50,686 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6aab306289443dd1ebc37d2169a12d8f/family1 of 6aab306289443dd1ebc37d2169a12d8f into 2845c90953204b20b1b27989cf1b5f9c(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:53:50,687 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:50,689 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1679507630083; duration=0sec 2023-03-22 17:53:50,690 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:53:50,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-22 17:53:50,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:50,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_] to archive 2023-03-22 17:53:50,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:50,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/8b59f2999c4c43468dd2be1463cf4013 2023-03-22 17:53:50,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/04e7d29dddfa4046b3948737844b8f7b 2023-03-22 17:53:50,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bf1b48ad921e4a7cbb6f68f7c2c2735f 2023-03-22 17:53:50,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f7a42c19742b45f8b973835971eccc5f 2023-03-22 17:53:50,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/32fa2c8848bf44a5a64a2081b78d7c5b 2023-03-22 17:53:50,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/bcbb1b92bccf4c8fb013c9cd701dc7a6 2023-03-22 17:53:50,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/e595238f2ed84526883e84318f0bf592 2023-03-22 17:53:50,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/d5a1988f25bc4a0fbf0cc55c6bac56fc 2023-03-22 17:53:50,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/74ca83010e39413da9c14e3bc0278e4c 2023-03-22 17:53:50,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/823988c7f0224a5394d945e534ffe8f9_SeqId_44_ 2023-03-22 17:53:51,128 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-22 17:53:51,131 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:51,131 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-22 17:53:51,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-22 17:53:51,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, REOPEN/MOVE}] 2023-03-22 17:53:51,153 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, REOPEN/MOVE 2023-03-22 17:53:51,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:51,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507631154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507631154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507631154"}]},"ts":"1679507631154"} 2023-03-22 17:53:51,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:51,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6aab306289443dd1ebc37d2169a12d8f, disabling compactions & flushes 2023-03-22 17:53:51,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. after waiting 0 ms 2023-03-22 17:53:51,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-22 17:53:51,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:51,333 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 6aab306289443dd1ebc37d2169a12d8f to self. 2023-03-22 17:53:51,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=CLOSED 2023-03-22 17:53:51,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507631336"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507631336"}]},"ts":"1679507631336"} 2023-03-22 17:53:51,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-22 17:53:51,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635 in 182 msec 2023-03-22 17:53:51,343 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=true 2023-03-22 17:53:51,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:51,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507631493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507631493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507631493"}]},"ts":"1679507631493"} 2023-03-22 17:53:51,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:51,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aab306289443dd1ebc37d2169a12d8f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,665 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,667 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:51,667 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:51,668 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aab306289443dd1ebc37d2169a12d8f columnFamilyName family1 2023-03-22 17:53:51,685 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9 2023-03-22 17:53:51,705 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c 2023-03-22 17:53:51,712 DEBUG [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ 2023-03-22 17:53:51,713 INFO [StoreOpener-6aab306289443dd1ebc37d2169a12d8f-1] regionserver.HStore(310): Store=6aab306289443dd1ebc37d2169a12d8f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:51,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:53:51,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6aab306289443dd1ebc37d2169a12d8f; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74760172, jitterRate=0.11401337385177612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:53:51,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:51,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., pid=17, masterSystemTime=1679507631656 2023-03-22 17:53:51,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:53:51,728 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:53:51,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,732 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:53:51,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6aab306289443dd1ebc37d2169a12d8f, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:51,732 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1912): 6aab306289443dd1ebc37d2169a12d8f/family1 is initiating minor compaction (all files) 2023-03-22 17:53:51,732 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6aab306289443dd1ebc37d2169a12d8f/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:53:51,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679507631732"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507631732"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507631732"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507631732"}]},"ts":"1679507631732"} 2023-03-22 17:53:51,733 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp, totalSize=358.6 K 2023-03-22 17:53:51,733 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 23a67596e45b4789a567fc22ecfaf3b9, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:53:51,734 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2845c90953204b20b1b27989cf1b5f9c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:53:51,735 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878841570 2023-03-22 17:53:51,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-22 17:53:51,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 6aab306289443dd1ebc37d2169a12d8f, server=jenkins-hbase4.apache.org,46619,1679507617635 in 232 msec 2023-03-22 17:53:51,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-22 17:53:51,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6aab306289443dd1ebc37d2169a12d8f, REOPEN/MOVE in 588 msec 2023-03-22 17:53:51,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-22 17:53:51,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 610 msec 2023-03-22 17:53:51,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0490 sec 2023-03-22 17:53:51,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-22 17:53:51,767 INFO [Listener at localhost/34365] compactions.TestMobCompactor(278): alter status finished 2023-03-22 17:53:51,777 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-22 17:53:51,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:51,781 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:51,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:53:51,783 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508231783 2023-03-22 17:53:51,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:53:51,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-22 17:53:51,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:51,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x09469b6f to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:51,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77199a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:51,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:51,836 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6aab306289443dd1ebc37d2169a12d8f#family1#compaction#11 average throughput is 2.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:53:52,311 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/.tmp/family1/f15580ab62a5492fb5ade0292f6db297 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/f15580ab62a5492fb5ade0292f6db297 2023-03-22 17:53:52,326 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6aab306289443dd1ebc37d2169a12d8f/family1 of 6aab306289443dd1ebc37d2169a12d8f into f15580ab62a5492fb5ade0292f6db297(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:53:52,326 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:52,326 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., storeName=6aab306289443dd1ebc37d2169a12d8f/family1, priority=13, startTime=1679507631726; duration=0sec 2023-03-22 17:53:52,326 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:53:52,351 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281b9d6e2d7aa5440eaa35d53e65864e36 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511281b9d6e2d7aa5440eaa35d53e65864e36 2023-03-22 17:53:52,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:52,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_] to archive 2023-03-22 17:53:52,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:52,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/23a67596e45b4789a567fc22ecfaf3b9 2023-03-22 17:53:52,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/2845c90953204b20b1b27989cf1b5f9c 2023-03-22 17:53:52,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/c69a7b03c50a43baa5e6f8768e6b4444_SeqId_46_ 2023-03-22 17:53:52,390 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:52,392 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:52,411 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:53:52,416 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:53:52,455 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/44dd33ed5bc24d95a1a7e358000898ef first=Optional[r05] last=Optional[r8] 2023-03-22 17:53:52,457 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=50 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/44dd33ed5bc24d95a1a7e358000898ef}] 2023-03-22 17:53:52,486 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/44dd33ed5bc24d95a1a7e358000898ef for inclusion in 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:52,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-22 17:53:52,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:53:52,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:53:52,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/44dd33ed5bc24d95a1a7e358000898ef to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8j69n8mc4j8ps08pfhtf6t2orntpjp7cvk44kc2efn035q4ceh67p2g4fd0dehjk/family1/44dd33ed5bc24d95a1a7e358000898ef 2023-03-22 17:53:52,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8j69n8mc4j8ps08pfhtf6t2orntpjp7cvk44kc2efn035q4ceh67p2g4fd0dehjk/family1/44dd33ed5bc24d95a1a7e358000898ef as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/9df18cb2f38744e9abaaaa0787fd8eee_SeqId_53_ 2023-03-22 17:53:52,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8j69n8mc4j8ps08pfhtf6t2orntpjp7cvk44kc2efn035q4ceh67p2g4fd0dehjk/family1/44dd33ed5bc24d95a1a7e358000898ef into 6aab306289443dd1ebc37d2169a12d8f/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/9df18cb2f38744e9abaaaa0787fd8eee_SeqId_53_ - updating store file list. 2023-03-22 17:53:52,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/9df18cb2f38744e9abaaaa0787fd8eee_SeqId_53_ into 6aab306289443dd1ebc37d2169a12d8f/family1 2023-03-22 17:53:52,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8j69n8mc4j8ps08pfhtf6t2orntpjp7cvk44kc2efn035q4ceh67p2g4fd0dehjk/family1/44dd33ed5bc24d95a1a7e358000898ef into 6aab306289443dd1ebc37d2169a12d8f/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/family1/9df18cb2f38744e9abaaaa0787fd8eee_SeqId_53_) 2023-03-22 17:53:52,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8j69n8mc4j8ps08pfhtf6t2orntpjp7cvk44kc2efn035q4ceh67p2g4fd0dehjk/family1/44dd33ed5bc24d95a1a7e358000898ef 2023-03-22 17:53:52,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:52,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:52,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203009bafb45e541bc9fecfdcdea67ce9e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203009bafb45e541bc9fecfdcdea67ce9e 2023-03-22 17:53:52,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128b07c81292f55474f9e25377636347141 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128b07c81292f55474f9e25377636347141 2023-03-22 17:53:52,533 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-22 17:53:52,533 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-22 17:53:52,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:52,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:52,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-22 17:53:52,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-22 17:53:52,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:53:52,536 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-22 17:53:52,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 758 msec 2023-03-22 17:53:52,740 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 210) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x483e0a19-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48240 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48114 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d64842-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48096 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48102 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48016 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48150 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x09469b6f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/810732635.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d64842-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x09469b6f-SendThread(127.0.0.1:60739) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48250 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48054 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2e155472-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48050 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x483e0a19-SendThread(127.0.0.1:60739) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48052 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:47980 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2e155472-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d64842-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d64842-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48142 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2e155472-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:46619-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:47956 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48108 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x09469b6f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x483e0a19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/810732635.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1624534536_15 at /127.0.0.1:48070 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d64842-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6347 (was 6718) 2023-03-22 17:53:52,760 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=169, AvailableMemoryMB=6346 2023-03-22 17:53:52,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-22 17:53:52,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:52,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:53:52,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-22 17:53:52,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:53:52,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-22 17:53:52,771 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:52,772 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c empty. 2023-03-22 17:53:52,773 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:52,773 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-22 17:53:52,794 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-22 17:53:52,797 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 784eca6306992fa6c06378bcbb05395c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 784eca6306992fa6c06378bcbb05395c, disabling compactions & flushes 2023-03-22 17:53:52,811 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. after waiting 0 ms 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:52,811 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:52,811 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:52,815 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:53:52,816 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507632816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507632816"}]},"ts":"1679507632816"} 2023-03-22 17:53:52,818 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:53:52,819 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:53:52,820 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507632819"}]},"ts":"1679507632819"} 2023-03-22 17:53:52,821 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-22 17:53:52,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=784eca6306992fa6c06378bcbb05395c, ASSIGN}] 2023-03-22 17:53:52,830 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=784eca6306992fa6c06378bcbb05395c, ASSIGN 2023-03-22 17:53:52,831 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=784eca6306992fa6c06378bcbb05395c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:53:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-22 17:53:52,984 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=784eca6306992fa6c06378bcbb05395c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:52,984 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507632984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507632984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507632984"}]},"ts":"1679507632984"} 2023-03-22 17:53:52,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 784eca6306992fa6c06378bcbb05395c, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:53:53,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-22 17:53:53,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:53,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 784eca6306992fa6c06378bcbb05395c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:53:53,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:53:53,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,150 INFO [StoreOpener-784eca6306992fa6c06378bcbb05395c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,154 DEBUG [StoreOpener-784eca6306992fa6c06378bcbb05395c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:53:53,154 DEBUG [StoreOpener-784eca6306992fa6c06378bcbb05395c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:53:53,154 INFO [StoreOpener-784eca6306992fa6c06378bcbb05395c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 784eca6306992fa6c06378bcbb05395c columnFamilyName family1 2023-03-22 17:53:53,156 INFO [StoreOpener-784eca6306992fa6c06378bcbb05395c-1] regionserver.HStore(310): Store=784eca6306992fa6c06378bcbb05395c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:53:53,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:53:53,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:53:53,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 784eca6306992fa6c06378bcbb05395c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70623954, jitterRate=0.05237892270088196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:53:53,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:53,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., pid=21, masterSystemTime=1679507633142 2023-03-22 17:53:53,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:53,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:53,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=784eca6306992fa6c06378bcbb05395c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,183 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507633183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507633183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507633183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507633183"}]},"ts":"1679507633183"} 2023-03-22 17:53:53,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-22 17:53:53,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 784eca6306992fa6c06378bcbb05395c, server=jenkins-hbase4.apache.org,46619,1679507617635 in 198 msec 2023-03-22 17:53:53,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-22 17:53:53,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=784eca6306992fa6c06378bcbb05395c, ASSIGN in 361 msec 2023-03-22 17:53:53,197 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:53:53,198 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507633198"}]},"ts":"1679507633198"} 2023-03-22 17:53:53,201 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-22 17:53:53,250 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:53:53,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 487 msec 2023-03-22 17:53:53,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-22 17:53:53,378 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-22 17:53:53,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:53,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,448 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:53,448 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:53,448 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:53,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:53,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,495 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,496 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:53,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:53,496 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,496 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,498 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:53,498 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:53,499 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:53,499 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:53,499 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:53,499 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:53,499 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:53,500 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:53:53,544 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b3d2f649e4a54d1993d194de3e575683 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3d2f649e4a54d1993d194de3e575683 2023-03-22 17:53:53,951 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/18fef9330a75460c9b7b64a1d4054106 2023-03-22 17:53:53,959 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/18fef9330a75460c9b7b64a1d4054106 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106 2023-03-22 17:53:53,969 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-22 17:53:53,970 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 470ms, sequenceid=5, compaction requested=false 2023-03-22 17:53:53,970 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:53,971 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:53,971 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:53,971 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:53,974 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:53,974 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:53,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:53,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2224b325[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:53,979 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:53,979 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,982 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:53,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:53,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:53,984 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:53,984 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,984 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:53,984 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:53,985 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:53,985 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:53,985 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:53,985 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:53,985 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:53,985 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,986 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:53,989 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,989 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,989 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:53,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:53,990 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,992 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:53,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:53,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:53,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:53,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:53,998 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:53,999 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:53,999 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:53,998 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,000 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,000 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:54,100 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:54,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:54,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:54,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:54,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,118 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:54,118 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,126 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:54,126 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:54,127 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,127 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,129 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:54,129 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:54,129 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,130 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:54,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:54,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,131 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:54,131 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:54,133 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:54,133 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:54,133 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:53:54,170 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284bc46f3307564e36bd80e76acb58266a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284bc46f3307564e36bd80e76acb58266a 2023-03-22 17:53:54,179 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/37f597ea13914e7d9e154b62399aec7f 2023-03-22 17:53:54,187 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/37f597ea13914e7d9e154b62399aec7f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f 2023-03-22 17:53:54,195 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:53:54,196 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 63ms, sequenceid=9, compaction requested=false 2023-03-22 17:53:54,196 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:54,196 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:54,196 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:54,196 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:54,196 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,196 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:54,196 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:54,198 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,198 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,199 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,199 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:54,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:54,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@636e966c[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:54,201 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:54,201 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,202 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,203 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:54,203 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,203 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:54,203 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:54,203 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:54,205 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:54,205 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:54,205 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:54,207 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:54,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:54,210 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:54,210 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:54,210 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:54,210 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,211 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:54,214 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,215 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,215 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:54,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,215 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,217 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:54,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:54,222 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:54,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,222 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:54,223 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,223 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,223 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,223 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:54,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:54,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:54,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:54,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:54,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:54,224 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:54,224 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:54,324 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:54,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:54,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:54,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:54,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,335 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:54,335 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,335 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:54,335 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:54,336 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,336 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,337 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,337 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:54,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:54,338 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,338 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:54,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:54,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:54,339 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:54,340 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:54,340 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:54,340 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:54,340 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:54,358 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201290c6b042d1a4da5a23c0286c8df2e71 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201290c6b042d1a4da5a23c0286c8df2e71 2023-03-22 17:53:54,364 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/5e1a0300f93f4fb798d952b454ce6466 2023-03-22 17:53:54,370 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/5e1a0300f93f4fb798d952b454ce6466 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466 2023-03-22 17:53:54,376 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466, entries=1, sequenceid=13, filesize=4.9 K 2023-03-22 17:53:54,377 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 37ms, sequenceid=13, compaction requested=true 2023-03-22 17:53:54,377 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:54,377 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:54,377 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:54,377 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:54,377 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,378 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:54,378 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:54,380 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,380 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,381 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,381 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:54,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70bc556[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:54,383 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:54,383 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,384 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:54,385 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,385 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:54,387 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:54,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:54,391 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:54,391 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:54,391 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:54,391 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,391 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:54,393 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,393 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:54,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,393 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:54,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:54,394 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,395 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,398 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,398 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,398 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,398 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,398 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:54,398 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,399 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:54,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:54,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:54,399 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:54,399 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,399 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,399 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:54,400 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:54,500 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:54,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:54,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,511 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:54,511 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,512 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:54,512 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:54,512 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,513 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,514 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,514 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:54,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:54,514 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:54,514 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:54,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:54,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:54,520 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:54,520 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:54,521 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:54,521 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:54,521 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:54,521 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:54,521 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:54,521 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:54,965 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205838a570349274113a7a318a897fcfb87 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205838a570349274113a7a318a897fcfb87 2023-03-22 17:53:55,372 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/0a0cd1d9caf74aecaefd1d3e5f47529a 2023-03-22 17:53:55,379 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/0a0cd1d9caf74aecaefd1d3e5f47529a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a 2023-03-22 17:53:55,384 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a, entries=1, sequenceid=17, filesize=4.9 K 2023-03-22 17:53:55,386 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 865ms, sequenceid=17, compaction requested=true 2023-03-22 17:53:55,386 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:55,386 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:55,386 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:55,388 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,388 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,389 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,389 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:55,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b6b066[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:55,390 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:55,391 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,392 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,392 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:55,392 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:55,392 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:55,393 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,393 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:55,395 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:55,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:55,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:55,399 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:55,399 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:55,399 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:55,399 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,399 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:55,406 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,407 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,409 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:55,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:55,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:55,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,413 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:55,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:55,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:55,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:55,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:55,414 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:55,415 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:55,515 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:55,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:55,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:55,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,525 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:55,525 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:55,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:55,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:55,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,527 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,528 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:55,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:55,529 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:55,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,530 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,530 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:55,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,531 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:55,531 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:55,531 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:55,532 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:55,532 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:55,532 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:55,532 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:55,551 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228cacaaa7b52d046bdbd9452df84763e54 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cacaaa7b52d046bdbd9452df84763e54 2023-03-22 17:53:55,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/cb339602691e41518be35a9d6ba3c716 2023-03-22 17:53:55,564 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/cb339602691e41518be35a9d6ba3c716 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716 2023-03-22 17:53:55,571 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716, entries=1, sequenceid=21, filesize=4.9 K 2023-03-22 17:53:55,572 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 40ms, sequenceid=21, compaction requested=true 2023-03-22 17:53:55,573 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:55,573 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:55,575 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,575 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,576 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,576 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:55,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:55,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@420c9e6e[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:55,577 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:55,577 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,578 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:55,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:55,579 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,579 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:55,579 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:55,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:55,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:55,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:55,588 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:55,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:55,591 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:55,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:55,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:55,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,592 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:55,598 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,598 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,598 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:55,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:55,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,599 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:55,600 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:55,611 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:55,611 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,612 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,612 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,612 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,612 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:55,613 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:55,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:55,713 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:55,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:55,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:55,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:55,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,727 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:55,727 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:55,728 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:55,728 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:55,729 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,729 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,730 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,730 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:55,731 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:55,731 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,732 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:55,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:55,736 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:55,736 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:55,736 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:55,736 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:55,736 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:56,160 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123123bec0514f8c46c8b1ffc193e79506eb to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123123bec0514f8c46c8b1ffc193e79506eb 2023-03-22 17:53:56,568 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/480e1a8391ec4052b988c785af911d29 2023-03-22 17:53:56,574 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/480e1a8391ec4052b988c785af911d29 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29 2023-03-22 17:53:56,580 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29, entries=1, sequenceid=25, filesize=4.9 K 2023-03-22 17:53:56,581 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 845ms, sequenceid=25, compaction requested=true 2023-03-22 17:53:56,581 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:56,581 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:56,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:56,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:56,582 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:56,583 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,583 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:56,584 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:56,584 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:56,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:56,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55c6bdb5[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:56,586 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:56,586 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,587 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,587 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:56,587 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:56,587 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:56,588 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,588 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:56,590 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,590 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,590 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:56,590 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:56,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:56,594 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:56,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:56,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:56,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,594 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:56,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:56,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:56,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,597 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,598 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:56,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:56,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:56,601 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:56,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:56,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:56,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:56,602 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:56,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:56,702 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:56,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:56,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:56,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:56,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,712 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:56,712 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:56,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:56,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:56,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,714 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,715 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:56,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:56,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:56,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:56,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:56,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:56,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,717 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:56,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:56,717 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:56,717 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:56,717 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:56,718 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:56,718 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:56,718 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:56,718 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:56,718 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:56,736 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fbf7ed325d764e3fa286a115aff0328d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101fbf7ed325d764e3fa286a115aff0328d 2023-03-22 17:53:56,893 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:53:57,153 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/2990b85ae06b48b2802c43174db36acf 2023-03-22 17:53:57,160 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/2990b85ae06b48b2802c43174db36acf as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf 2023-03-22 17:53:57,166 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf, entries=1, sequenceid=29, filesize=4.9 K 2023-03-22 17:53:57,167 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 449ms, sequenceid=29, compaction requested=true 2023-03-22 17:53:57,167 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:57,167 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:57,167 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:57,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,171 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:57,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cbee32e[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:57,174 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:57,174 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,177 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,177 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:57,177 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:57,177 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:57,177 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,177 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:57,179 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:57,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:57,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:57,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:57,183 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:57,183 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:57,183 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:57,183 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,183 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:57,186 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,186 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,186 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,187 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,189 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,201 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:57,201 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:57,201 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,202 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,201 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:57,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:57,202 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:57,202 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,203 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,203 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,203 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:57,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:57,204 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:57,204 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:57,304 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:57,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:57,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:57,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:57,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,322 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:57,322 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:57,324 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:57,324 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:57,325 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,325 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,327 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:57,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:57,328 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,329 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,329 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,330 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:57,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,336 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:57,336 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:57,337 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:57,337 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:57,337 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:57,337 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:57,337 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:57,338 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:57,375 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103064188300b61451cb8bed291d4b62bab to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103064188300b61451cb8bed291d4b62bab 2023-03-22 17:53:57,783 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622 2023-03-22 17:53:57,791 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622 2023-03-22 17:53:57,798 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622, entries=1, sequenceid=33, filesize=4.9 K 2023-03-22 17:53:57,799 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 461ms, sequenceid=33, compaction requested=true 2023-03-22 17:53:57,799 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:57,799 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:57,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:57,801 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,801 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,802 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:57,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c7b575f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:57,805 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:57,805 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,806 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,806 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:57,806 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,807 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:57,806 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:57,807 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:57,812 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:57,812 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:57,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:57,816 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:57,816 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:57,816 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:57,816 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,816 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:57,818 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,819 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:57,819 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:57,820 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,822 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,825 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:57,825 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,825 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:57,825 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:57,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:57,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:57,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:57,825 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:57,825 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,826 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:57,826 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:57,826 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:57,826 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,827 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,827 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,926 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:57,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:57,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:57,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,942 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:57,942 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:57,942 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:57,942 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:57,943 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,943 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,944 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:57,944 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,945 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:57,945 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:57,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,946 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:57,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:57,947 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:57,947 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:57,947 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:57,947 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:57,947 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:57,947 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:57,947 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:58,376 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090704099c3e87c048bcbfe63fab6d4d03ee to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090704099c3e87c048bcbfe63fab6d4d03ee 2023-03-22 17:53:58,385 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/117492a3ed41442a8e672fd476ebcae2 2023-03-22 17:53:58,392 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/117492a3ed41442a8e672fd476ebcae2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2 2023-03-22 17:53:58,401 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2, entries=1, sequenceid=37, filesize=4.9 K 2023-03-22 17:53:58,403 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 456ms, sequenceid=37, compaction requested=true 2023-03-22 17:53:58,403 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:58,403 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:58,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:58,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:58,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:58,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:58,406 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:58,407 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:58,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:58,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aa25950[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:58,410 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:58,411 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,413 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,413 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:58,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,414 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,414 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:58,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,414 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:58,414 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:58,414 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:58,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:58,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:58,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:58,419 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:58,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:58,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:58,425 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:58,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:58,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:58,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,425 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:58,428 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:58,428 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,428 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:58,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,429 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,430 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:58,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:58,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:58,434 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:58,434 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,435 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:58,435 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,436 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,436 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:58,436 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:58,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:58,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:58,536 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:58,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:58,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:53:58,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:53:58,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,547 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:58,548 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:58,548 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:53:58,548 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:53:58,549 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,549 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,550 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:58,550 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:58,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:58,551 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:58,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,551 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:53:58,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:53:58,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:53:58,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:58,552 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:53:58,552 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:53:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:53:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:53:58,554 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:53:58,554 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:58,554 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. started... 2023-03-22 17:53:58,554 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 784eca6306992fa6c06378bcbb05395c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:53:58,994 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d1c614f275a1450a8fde9db416a32413 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1c614f275a1450a8fde9db416a32413 2023-03-22 17:53:59,002 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/dbeae86ba65346428c1a3a05e6eac7d2 2023-03-22 17:53:59,012 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/dbeae86ba65346428c1a3a05e6eac7d2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2 2023-03-22 17:53:59,037 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2, entries=1, sequenceid=41, filesize=4.9 K 2023-03-22 17:53:59,039 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 784eca6306992fa6c06378bcbb05395c in 485ms, sequenceid=41, compaction requested=true 2023-03-22 17:53:59,039 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:59,039 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:59,039 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:53:59,039 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:53:59,040 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,040 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:53:59,040 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:53:59,081 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,081 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:59,081 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,082 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:53:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:53:59,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae97ca4[Count = 0] remaining members to acquire global barrier 2023-03-22 17:53:59,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,135 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:53:59,135 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:53:59,135 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:53:59,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:53:59,188 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,188 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:53:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:59,189 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:59,189 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:53:59,193 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:53:59,193 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:53:59,193 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:53:59,193 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,193 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:53:59,266 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,266 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,266 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:53:59,266 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:53:59,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:53:59,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:53:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:53:59,312 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:53:59,312 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:53:59,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-22 17:53:59,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:53:59,315 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:53:59,315 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:53:59,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:53:59,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:53:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:53:59,415 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:53:59,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:53:59,418 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-22 17:53:59,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:53:59,437 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:53:59,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:53:59,438 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508239438 2023-03-22 17:53:59,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:53:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-22 17:53:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:53:59,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x729e59a9 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:53:59,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a9228b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:53:59,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:53:59,515 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359322ca749e44d4195143725bb8584da to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010359322ca749e44d4195143725bb8584da 2023-03-22 17:53:59,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:53:59,535 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:53:59,536 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:53:59,567 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:53:59,569 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:53:59,590 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7832f744b6a04f049a83022a6b27ac3e first=Optional[r5] last=Optional[r6] 2023-03-22 17:53:59,591 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7832f744b6a04f049a83022a6b27ac3e}] 2023-03-22 17:53:59,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7832f744b6a04f049a83022a6b27ac3e for inclusion in 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:53:59,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-22 17:53:59,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:53:59,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:53:59,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7832f744b6a04f049a83022a6b27ac3e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__4kmsqe7ajiidadkl1ns1hsabmdfhtb70sse22hlfgltcodf18ofa8hn91lot51ks/family1/7832f744b6a04f049a83022a6b27ac3e 2023-03-22 17:53:59,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__4kmsqe7ajiidadkl1ns1hsabmdfhtb70sse22hlfgltcodf18ofa8hn91lot51ks/family1/7832f744b6a04f049a83022a6b27ac3e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_ 2023-03-22 17:53:59,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__4kmsqe7ajiidadkl1ns1hsabmdfhtb70sse22hlfgltcodf18ofa8hn91lot51ks/family1/7832f744b6a04f049a83022a6b27ac3e into 784eca6306992fa6c06378bcbb05395c/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_ - updating store file list. 2023-03-22 17:53:59,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_ into 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:53:59,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__4kmsqe7ajiidadkl1ns1hsabmdfhtb70sse22hlfgltcodf18ofa8hn91lot51ks/family1/7832f744b6a04f049a83022a6b27ac3e into 784eca6306992fa6c06378bcbb05395c/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_) 2023-03-22 17:53:59,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__4kmsqe7ajiidadkl1ns1hsabmdfhtb70sse22hlfgltcodf18ofa8hn91lot51ks/family1/7832f744b6a04f049a83022a6b27ac3e 2023-03-22 17:53:59,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:53:59,676 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:53:59,676 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09469b6f to 127.0.0.1:60739 2023-03-22 17:53:59,676 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:53:59,678 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:53:59,678 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x483e0a19 to 127.0.0.1:60739 2023-03-22 17:53:59,678 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:53:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:53:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 784eca6306992fa6c06378bcbb05395c/family1 is initiating minor compaction 2023-03-22 17:53:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3e04e7c4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:53:59,686 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 784eca6306992fa6c06378bcbb05395c/family1 in testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:53:59,686 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp, totalSize=49.7 K 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 37f597ea13914e7d9e154b62399aec7f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5e1a0300f93f4fb798d952b454ce6466, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 0a0cd1d9caf74aecaefd1d3e5f47529a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting cb339602691e41518be35a9d6ba3c716, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 480e1a8391ec4052b988c785af911d29, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2990b85ae06b48b2802c43174db36acf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:53:59,686 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2ca72b357ccc4ca6ad2df1a6dc1b5622, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:53:59,687 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 117492a3ed41442a8e672fd476ebcae2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:53:59,687 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting dbeae86ba65346428c1a3a05e6eac7d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:53:59,687 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 72426e0145ba4de9b443ea89e5179eb5_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:53:59,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:53:59,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:53:59,694 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101fbf7ed325d764e3fa286a115aff0328d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101fbf7ed325d764e3fa286a115aff0328d 2023-03-22 17:53:59,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103064188300b61451cb8bed291d4b62bab to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103064188300b61451cb8bed291d4b62bab 2023-03-22 17:53:59,696 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-22 17:53:59,696 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-22 17:53:59,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:53:59,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:53:59,755 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 784eca6306992fa6c06378bcbb05395c#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:00,176 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/27350d7fdff54ea88b9cf9abcc277f11 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/27350d7fdff54ea88b9cf9abcc277f11 2023-03-22 17:54:00,183 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ea9b6c3149fc4321bec3092a010f6642 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ea9b6c3149fc4321bec3092a010f6642 2023-03-22 17:54:00,184 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:54:00,188 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 784eca6306992fa6c06378bcbb05395c/family1 of 784eca6306992fa6c06378bcbb05395c into 27350d7fdff54ea88b9cf9abcc277f11(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:00,188 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:54:00,188 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679507639685; duration=0sec 2023-03-22 17:54:00,189 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:00,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/44f6d9d79251491b8a57b1b73e50c92a first=Optional[r1] last=Optional[r4] 2023-03-22 17:54:00,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/44f6d9d79251491b8a57b1b73e50c92a}] 2023-03-22 17:54:00,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/44f6d9d79251491b8a57b1b73e50c92a for inclusion in 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:54:00,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-22 17:54:00,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:00,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:54:00,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/44f6d9d79251491b8a57b1b73e50c92a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v4phu5s9lmmq10ud3hf24fpiabpjffvg30no8ett9nge25i187hpeuj5bd01icnc/family1/44f6d9d79251491b8a57b1b73e50c92a 2023-03-22 17:54:00,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v4phu5s9lmmq10ud3hf24fpiabpjffvg30no8ett9nge25i187hpeuj5bd01icnc/family1/44f6d9d79251491b8a57b1b73e50c92a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_ 2023-03-22 17:54:00,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v4phu5s9lmmq10ud3hf24fpiabpjffvg30no8ett9nge25i187hpeuj5bd01icnc/family1/44f6d9d79251491b8a57b1b73e50c92a into 784eca6306992fa6c06378bcbb05395c/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_ - updating store file list. 2023-03-22 17:54:00,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_ into 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:54:00,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v4phu5s9lmmq10ud3hf24fpiabpjffvg30no8ett9nge25i187hpeuj5bd01icnc/family1/44f6d9d79251491b8a57b1b73e50c92a into 784eca6306992fa6c06378bcbb05395c/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_) 2023-03-22 17:54:00,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v4phu5s9lmmq10ud3hf24fpiabpjffvg30no8ett9nge25i187hpeuj5bd01icnc/family1/44f6d9d79251491b8a57b1b73e50c92a 2023-03-22 17:54:00,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:54:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:54:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 784eca6306992fa6c06378bcbb05395c/family1 is initiating minor compaction (all files) 2023-03-22 17:54:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4082c7d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:00,246 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 784eca6306992fa6c06378bcbb05395c/family1 in testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:54:00,246 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/27350d7fdff54ea88b9cf9abcc277f11, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp, totalSize=178.1 K 2023-03-22 17:54:00,247 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 18fef9330a75460c9b7b64a1d4054106, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:54:00,248 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 27350d7fdff54ea88b9cf9abcc277f11, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:54:00,249 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241570 2023-03-22 17:54:00,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_] to archive 2023-03-22 17:54:00,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:00,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:54:00,265 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:00,267 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201290c6b042d1a4da5a23c0286c8df2e71 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201290c6b042d1a4da5a23c0286c8df2e71 2023-03-22 17:54:00,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205838a570349274113a7a318a897fcfb87 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205838a570349274113a7a318a897fcfb87 2023-03-22 17:54:00,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/37f597ea13914e7d9e154b62399aec7f 2023-03-22 17:54:00,272 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cacaaa7b52d046bdbd9452df84763e54 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cacaaa7b52d046bdbd9452df84763e54 2023-03-22 17:54:00,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/5e1a0300f93f4fb798d952b454ce6466 2023-03-22 17:54:00,276 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123123bec0514f8c46c8b1ffc193e79506eb to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123123bec0514f8c46c8b1ffc193e79506eb 2023-03-22 17:54:00,276 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-22 17:54:00,276 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-22 17:54:00,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:54:00,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:54:00,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/0a0cd1d9caf74aecaefd1d3e5f47529a 2023-03-22 17:54:00,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/cb339602691e41518be35a9d6ba3c716 2023-03-22 17:54:00,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/480e1a8391ec4052b988c785af911d29 2023-03-22 17:54:00,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2990b85ae06b48b2802c43174db36acf 2023-03-22 17:54:00,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/2ca72b357ccc4ca6ad2df1a6dc1b5622 2023-03-22 17:54:00,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/117492a3ed41442a8e672fd476ebcae2 2023-03-22 17:54:00,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dbeae86ba65346428c1a3a05e6eac7d2 2023-03-22 17:54:00,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/72426e0145ba4de9b443ea89e5179eb5_SeqId_44_ 2023-03-22 17:54:00,327 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 784eca6306992fa6c06378bcbb05395c#family1#compaction#23 average throughput is 4.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:00,452 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113045028ac961e84a44b9aeebaa84325bd2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113045028ac961e84a44b9aeebaa84325bd2 2023-03-22 17:54:00,453 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:54:00,501 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/78f50223079446b8a33edf8f74ccb389 first=Optional[r00] last=Optional[r8] 2023-03-22 17:54:00,505 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/78f50223079446b8a33edf8f74ccb389}] 2023-03-22 17:54:00,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/78f50223079446b8a33edf8f74ccb389 for inclusion in 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:54:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-22 17:54:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:54:00,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/78f50223079446b8a33edf8f74ccb389 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k8lv5333v415nfu57q6j4pt43iqhjd7uqp0k1p0h8g6nq2tkps63o6gl4kt5f857/family1/78f50223079446b8a33edf8f74ccb389 2023-03-22 17:54:00,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k8lv5333v415nfu57q6j4pt43iqhjd7uqp0k1p0h8g6nq2tkps63o6gl4kt5f857/family1/78f50223079446b8a33edf8f74ccb389 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dccc6f5c245b45a283187ee17ffb6203_SeqId_49_ 2023-03-22 17:54:00,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k8lv5333v415nfu57q6j4pt43iqhjd7uqp0k1p0h8g6nq2tkps63o6gl4kt5f857/family1/78f50223079446b8a33edf8f74ccb389 into 784eca6306992fa6c06378bcbb05395c/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dccc6f5c245b45a283187ee17ffb6203_SeqId_49_ - updating store file list. 2023-03-22 17:54:00,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dccc6f5c245b45a283187ee17ffb6203_SeqId_49_ into 784eca6306992fa6c06378bcbb05395c/family1 2023-03-22 17:54:00,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k8lv5333v415nfu57q6j4pt43iqhjd7uqp0k1p0h8g6nq2tkps63o6gl4kt5f857/family1/78f50223079446b8a33edf8f74ccb389 into 784eca6306992fa6c06378bcbb05395c/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/dccc6f5c245b45a283187ee17ffb6203_SeqId_49_) 2023-03-22 17:54:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k8lv5333v415nfu57q6j4pt43iqhjd7uqp0k1p0h8g6nq2tkps63o6gl4kt5f857/family1/78f50223079446b8a33edf8f74ccb389 2023-03-22 17:54:00,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:54:00,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:00,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1c614f275a1450a8fde9db416a32413 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1c614f275a1450a8fde9db416a32413 2023-03-22 17:54:00,534 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284bc46f3307564e36bd80e76acb58266a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284bc46f3307564e36bd80e76acb58266a 2023-03-22 17:54:00,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3d2f649e4a54d1993d194de3e575683 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3d2f649e4a54d1993d194de3e575683 2023-03-22 17:54:00,536 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-22 17:54:00,536 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-22 17:54:00,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:54:00,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:54:00,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:54:00,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:54:00,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:00,540 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:00,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.1210 sec 2023-03-22 17:54:00,681 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=251 (was 249) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x729e59a9-SendThread(127.0.0.1:60739) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x729e59a9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/810732635.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35370 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35394 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48096 [Waiting for operation #35] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60739@0x729e59a9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35404 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35444 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:48102 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35288 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35306 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35260 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/98737cd95d814708b8553eb065e0a2b7 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x4d98dc23-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35460 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35318 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:47980 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d98dc23-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35520 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540276610_15 at /127.0.0.1:35448 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7d9b5f08-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1624534536_15 at /127.0.0.1:35332 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=319 (was 324), ProcessCount=169 (was 169), AvailableMemoryMB=6155 (was 6346) 2023-03-22 17:54:00,705 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=169, AvailableMemoryMB=6154 2023-03-22 17:54:00,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:54:00,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:00,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:00,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-22 17:54:00,714 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:00,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-22 17:54:00,716 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:00,717 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487 empty. 2023-03-22 17:54:00,718 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:00,718 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-22 17:54:00,739 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:00,742 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92f6a8c69f04feb2c2e2175aa2fcf487, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 92f6a8c69f04feb2c2e2175aa2fcf487, disabling compactions & flushes 2023-03-22 17:54:00,776 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. after waiting 0 ms 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:00,776 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:00,776 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:00,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:00,786 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507640786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507640786"}]},"ts":"1679507640786"} 2023-03-22 17:54:00,788 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:54:00,789 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:00,790 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507640789"}]},"ts":"1679507640789"} 2023-03-22 17:54:00,791 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-22 17:54:00,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=92f6a8c69f04feb2c2e2175aa2fcf487, ASSIGN}] 2023-03-22 17:54:00,802 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=92f6a8c69f04feb2c2e2175aa2fcf487, ASSIGN 2023-03-22 17:54:00,803 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=92f6a8c69f04feb2c2e2175aa2fcf487, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-22 17:54:00,856 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/.tmp/family1/98737cd95d814708b8553eb065e0a2b7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/98737cd95d814708b8553eb065e0a2b7 2023-03-22 17:54:00,864 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 784eca6306992fa6c06378bcbb05395c/family1 of 784eca6306992fa6c06378bcbb05395c into 98737cd95d814708b8553eb065e0a2b7(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:00,864 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:54:00,864 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679507640246; duration=0sec 2023-03-22 17:54:00,864 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:00,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/27350d7fdff54ea88b9cf9abcc277f11, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_] to archive 2023-03-22 17:54:00,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:00,955 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=92f6a8c69f04feb2c2e2175aa2fcf487, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:00,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/18fef9330a75460c9b7b64a1d4054106 2023-03-22 17:54:00,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507640955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507640955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507640955"}]},"ts":"1679507640955"} 2023-03-22 17:54:00,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/27350d7fdff54ea88b9cf9abcc277f11 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/27350d7fdff54ea88b9cf9abcc277f11 2023-03-22 17:54:00,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 92f6a8c69f04feb2c2e2175aa2fcf487, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:00,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/family1/1f69f405dfbf4070993665cdf1bcef1d_SeqId_47_ 2023-03-22 17:54:01,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-22 17:54:01,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92f6a8c69f04feb2c2e2175aa2fcf487, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:01,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:01,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,118 INFO [StoreOpener-92f6a8c69f04feb2c2e2175aa2fcf487-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,121 DEBUG [StoreOpener-92f6a8c69f04feb2c2e2175aa2fcf487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:01,122 DEBUG [StoreOpener-92f6a8c69f04feb2c2e2175aa2fcf487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:01,122 INFO [StoreOpener-92f6a8c69f04feb2c2e2175aa2fcf487-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92f6a8c69f04feb2c2e2175aa2fcf487 columnFamilyName family1 2023-03-22 17:54:01,124 INFO [StoreOpener-92f6a8c69f04feb2c2e2175aa2fcf487-1] regionserver.HStore(310): Store=92f6a8c69f04feb2c2e2175aa2fcf487/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:01,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:54:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:01,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92f6a8c69f04feb2c2e2175aa2fcf487; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74408579, jitterRate=0.10877422988414764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:01,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:01,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487., pid=25, masterSystemTime=1679507641112 2023-03-22 17:54:01,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=92f6a8c69f04feb2c2e2175aa2fcf487, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507641138"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507641138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507641138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507641138"}]},"ts":"1679507641138"} 2023-03-22 17:54:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-22 17:54:01,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 92f6a8c69f04feb2c2e2175aa2fcf487, server=jenkins-hbase4.apache.org,46619,1679507617635 in 181 msec 2023-03-22 17:54:01,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-22 17:54:01,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=92f6a8c69f04feb2c2e2175aa2fcf487, ASSIGN in 351 msec 2023-03-22 17:54:01,154 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:01,155 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507641155"}]},"ts":"1679507641155"} 2023-03-22 17:54:01,156 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-22 17:54:01,159 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:01,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 451 msec 2023-03-22 17:54:01,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-22 17:54:01,319 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-22 17:54:01,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:01,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,357 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:01,357 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:01,357 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:01,357 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:01,358 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,358 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,359 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:01,359 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:01,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:01,360 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,360 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:01,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,361 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,363 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:01,363 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:01,363 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:01,363 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:01,363 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:01,363 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,363 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:01,364 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:54:01,418 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113047fa419eccf84cf7b133cda5b6f816ce to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113047fa419eccf84cf7b133cda5b6f816ce 2023-03-22 17:54:01,424 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/36f9416f4e29496a9662dfbab79c8666 2023-03-22 17:54:01,431 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/36f9416f4e29496a9662dfbab79c8666 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666 2023-03-22 17:54:01,436 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-22 17:54:01,437 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 73ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:01,438 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:01,438 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:01,438 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:01,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:01,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:01,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:01,440 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,440 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:01,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:01,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:01,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b55f44[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:01,443 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:01,443 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,445 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,445 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:01,445 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:01,445 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,445 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:01,445 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:01,447 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,447 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:01,447 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:01,448 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:01,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:01,450 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:01,450 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:01,450 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:01,450 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,450 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:01,452 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:01,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,453 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:01,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:01,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,455 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,458 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:01,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:01,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:01,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:01,459 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:01,460 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:01,460 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:01,560 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:01,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:01,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:01,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:01,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,569 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:01,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:01,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:01,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:01,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,571 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:01,571 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,571 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:01,571 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:01,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:01,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:01,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:01,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:01,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:01,573 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:01,573 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:01,573 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:01,573 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:54:01,993 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f95924474ec341b6bc3a96a9be716ed2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128f95924474ec341b6bc3a96a9be716ed2 2023-03-22 17:54:02,000 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/1a82f6003bb14bf08501fbb081ac0032 2023-03-22 17:54:02,006 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/1a82f6003bb14bf08501fbb081ac0032 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032 2023-03-22 17:54:02,020 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:54:02,021 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 448ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:02,021 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:02,021 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:02,021 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:02,024 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,024 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,024 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,024 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:02,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67523982[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:02,027 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:02,027 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:02,028 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:02,029 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,029 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:02,031 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:02,031 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:02,031 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:02,032 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:02,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:02,035 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:02,036 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:02,036 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:02,036 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,036 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:02,038 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,038 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,038 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:02,039 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,041 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,044 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:02,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:02,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:02,044 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:02,045 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,045 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:02,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:02,045 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:02,045 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:02,045 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,145 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:02,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:02,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:02,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,156 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:02,156 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:02,156 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:02,156 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:02,157 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,157 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,158 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:02,158 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:02,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:02,158 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,159 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:02,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,160 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,160 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:02,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,160 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:02,160 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:02,160 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:02,160 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:02,160 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:02,160 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:02,161 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:02,161 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:02,200 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015147a85183384f8c97d56a0c9c697622 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015147a85183384f8c97d56a0c9c697622 2023-03-22 17:54:02,616 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/37685acdd36348709624080d11cb2d06 2023-03-22 17:54:02,624 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/37685acdd36348709624080d11cb2d06 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06 2023-03-22 17:54:02,630 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06, entries=1, sequenceid=13, filesize=4.9 K 2023-03-22 17:54:02,632 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 471ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:02,632 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:02,632 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:02,634 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,634 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,635 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,635 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:02,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ff284e1[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:02,637 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:02,637 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,639 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,639 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:02,641 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:02,644 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:02,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:02,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:02,651 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:02,651 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:02,651 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:02,651 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,651 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:02,653 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:02,653 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,654 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:02,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:02,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,655 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:02,657 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:02,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,664 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,665 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,665 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:02,667 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:02,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:02,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:02,667 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:02,668 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:02,768 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:02,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:02,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:02,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:02,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,780 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:02,781 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:02,781 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:02,781 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:02,781 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,781 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,782 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,783 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:02,783 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:02,783 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:02,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,785 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:02,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:02,785 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:02,785 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:02,788 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:03,206 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205caed40560fda4bbaa1761e5a89b2b9e6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205caed40560fda4bbaa1761e5a89b2b9e6 2023-03-22 17:54:03,615 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/ef872fa816bd4a3a95eb57b6c91ecdae 2023-03-22 17:54:03,622 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/ef872fa816bd4a3a95eb57b6c91ecdae as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae 2023-03-22 17:54:03,628 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae, entries=1, sequenceid=17, filesize=4.9 K 2023-03-22 17:54:03,629 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 841ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:03,629 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:03,629 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:03,629 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:03,629 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:03,629 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,629 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:03,629 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:03,631 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,631 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:03,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:03,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,632 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:03,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:03,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:03,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:03,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:03,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e0fc1e7[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:03,633 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:03,633 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,638 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:03,638 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:03,638 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,639 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:03,640 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:03,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:03,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:03,640 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:03,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:03,643 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:03,643 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:03,643 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:03,643 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,643 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:03,644 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,645 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,645 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:03,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:03,648 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:03,650 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:03,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:03,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:03,651 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:03,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:03,651 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:03,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:03,751 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:03,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:03,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:03,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:03,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,761 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:03,761 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:03,761 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:03,761 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:03,762 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,762 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,763 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,763 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:03,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:03,763 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:03,763 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:03,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:03,765 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:03,766 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:03,766 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:04,180 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bc8fb95fbb064838bcd547bf752d419d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc8fb95fbb064838bcd547bf752d419d 2023-03-22 17:54:04,586 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/b625aaed3f424cd185260510ed33f1ae 2023-03-22 17:54:04,591 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/b625aaed3f424cd185260510ed33f1ae as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae 2023-03-22 17:54:04,596 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae, entries=1, sequenceid=21, filesize=4.9 K 2023-03-22 17:54:04,597 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 831ms, sequenceid=21, compaction requested=true 2023-03-22 17:54:04,598 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:04,598 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:04,598 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:04,598 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:04,598 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,598 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:04,598 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:04,600 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,600 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:04,600 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,600 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:04,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:04,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35abfa1d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:04,601 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:04,601 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,603 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:04,603 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:04,603 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,603 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:04,603 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:04,605 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,605 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:04,605 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:04,605 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:04,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:04,607 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:04,607 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:04,607 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:04,607 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,607 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:04,609 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,609 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,609 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:04,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:04,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:04,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,610 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:04,613 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:04,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:04,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:04,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:04,613 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:04,714 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:04,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:04,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:04,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:04,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,721 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:04,721 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:04,721 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:04,721 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:04,721 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,721 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,723 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:04,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:04,723 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:04,723 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:04,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:04,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,724 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:04,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:04,725 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:04,725 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:04,725 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:05,138 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ef8273c480744e7592f56c9229187c5e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef8273c480744e7592f56c9229187c5e 2023-03-22 17:54:05,543 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/1e5339e551c24b58b355bc262893466d 2023-03-22 17:54:05,549 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/1e5339e551c24b58b355bc262893466d as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d 2023-03-22 17:54:05,554 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d, entries=1, sequenceid=25, filesize=4.9 K 2023-03-22 17:54:05,555 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 830ms, sequenceid=25, compaction requested=true 2023-03-22 17:54:05,555 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:05,555 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:05,555 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:05,555 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:05,555 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,555 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:05,555 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:05,557 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,557 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:05,557 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,557 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:05,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:05,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43c35b03[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:05,559 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:05,559 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,560 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:05,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:05,560 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,560 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:05,571 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:05,574 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:05,574 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:05,574 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:05,574 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,574 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:05,575 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,575 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,575 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:05,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:05,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:05,576 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,577 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,579 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:05,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:05,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:05,579 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,580 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,580 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:05,580 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:05,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:05,580 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,580 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,680 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:05,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:05,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:05,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:05,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,687 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:05,687 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:05,687 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:05,687 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:05,687 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,688 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,689 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,689 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:05,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:05,690 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:05,690 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,692 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:05,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:05,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:05,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:05,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:05,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:05,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:05,692 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:05,693 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:05,693 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:06,106 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a6686bad968f4c70bee503c8d95d0436 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a6686bad968f4c70bee503c8d95d0436 2023-03-22 17:54:06,511 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/44b20f222d504fdda27854b75e09434b 2023-03-22 17:54:06,517 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/44b20f222d504fdda27854b75e09434b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b 2023-03-22 17:54:06,521 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b, entries=1, sequenceid=29, filesize=4.9 K 2023-03-22 17:54:06,522 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 829ms, sequenceid=29, compaction requested=true 2023-03-22 17:54:06,522 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:06,522 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:06,522 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:06,524 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,524 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:06,524 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,524 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:06,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:06,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@782d0a16[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:06,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:06,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,527 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:06,527 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,527 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:06,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:06,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:06,528 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,528 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:06,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:06,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:06,528 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:06,529 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:06,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:06,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:06,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:06,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:06,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:06,530 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:06,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:06,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:06,531 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,531 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:06,533 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,533 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:06,533 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:06,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:06,534 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,535 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,537 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:06,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:06,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:06,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:06,537 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:06,538 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:06,618 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:06,638 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:06,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:06,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:06,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:06,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,645 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:06,645 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:06,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:06,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:06,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,647 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,647 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:06,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:06,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:06,648 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:06,648 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:06,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,648 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:06,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:06,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:06,649 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:06,649 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:06,649 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:07,062 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c1f361ad3bc14c879133c4d20258a45b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1f361ad3bc14c879133c4d20258a45b 2023-03-22 17:54:07,467 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/3c03b3a7c02541bb83c19638748ea789 2023-03-22 17:54:07,473 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/3c03b3a7c02541bb83c19638748ea789 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789 2023-03-22 17:54:07,477 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789, entries=1, sequenceid=33, filesize=4.9 K 2023-03-22 17:54:07,478 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 829ms, sequenceid=33, compaction requested=true 2023-03-22 17:54:07,478 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:07,478 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:07,480 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:07,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:07,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:07,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@580dfc0d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:07,482 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:07,482 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,484 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,484 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:07,484 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:07,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,484 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:07,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:07,485 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,485 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:07,485 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:07,486 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:07,488 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:07,488 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:07,488 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:07,488 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,488 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:07,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:07,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:07,491 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,493 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:07,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:07,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:07,493 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:07,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:07,494 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,494 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:07,494 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:07,494 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:07,494 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,594 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:07,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:07,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:07,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:07,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,602 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:07,602 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:07,602 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:07,602 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:07,602 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,602 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:07,604 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:07,605 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,605 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:07,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,605 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:07,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:07,606 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:07,606 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:07,606 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:08,019 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090762488b961183430da440f60494675375 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090762488b961183430da440f60494675375 2023-03-22 17:54:08,425 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/a4cb8662f09a411db152a5a62a065a67 2023-03-22 17:54:08,430 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/a4cb8662f09a411db152a5a62a065a67 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67 2023-03-22 17:54:08,435 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67, entries=1, sequenceid=37, filesize=4.9 K 2023-03-22 17:54:08,436 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 830ms, sequenceid=37, compaction requested=true 2023-03-22 17:54:08,436 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:08,436 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:08,438 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:08,438 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,439 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@329c9e03[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:08,440 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:08,440 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,444 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,444 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:08,445 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:08,444 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,445 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:08,445 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:08,446 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:08,446 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,446 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:08,446 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:08,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:08,449 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:08,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:08,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:08,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,449 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:08,450 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,450 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,451 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:08,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:08,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:08,451 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,453 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:08,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:08,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:08,456 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:08,457 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:08,457 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:08,456 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,457 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,457 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,557 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:08,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:08,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:08,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:08,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,563 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:08,563 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:08,563 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:08,563 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:08,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,565 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:08,565 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:08,565 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:08,565 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,566 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:08,566 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:08,567 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:08,567 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. started... 2023-03-22 17:54:08,567 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92f6a8c69f04feb2c2e2175aa2fcf487 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:08,981 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c53fbe97600a4cbd958c84b3fd66abf5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120c53fbe97600a4cbd958c84b3fd66abf5 2023-03-22 17:54:09,387 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/23ed0e79d7e54b62b45ede57eecdd994 2023-03-22 17:54:09,392 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/23ed0e79d7e54b62b45ede57eecdd994 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994 2023-03-22 17:54:09,396 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994, entries=1, sequenceid=41, filesize=4.9 K 2023-03-22 17:54:09,397 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92f6a8c69f04feb2c2e2175aa2fcf487 in 830ms, sequenceid=41, compaction requested=true 2023-03-22 17:54:09,397 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:09,397 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:09,399 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bded010[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:09,400 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:09,401 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,402 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,402 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:09,402 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:09,402 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:09,402 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,402 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:09,403 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:09,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:09,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:09,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:09,406 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:09,406 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:09,406 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:09,406 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,406 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:09,408 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,408 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:09,408 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,409 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:09,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,410 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:09,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-22 17:54:09,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:09,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:09,412 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:09,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:09,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:09,413 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:09,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,413 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:09,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,413 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,513 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:09,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:09,515 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-22 17:54:09,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:09,517 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:09,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:09,518 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508249518 2023-03-22 17:54:09,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:54:09,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-22 17:54:09,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:09,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x47be990d to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:09,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7733460b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:09,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,366 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037c44ac2fdf5f4b36bcb78c65dc3af68d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037c44ac2fdf5f4b36bcb78c65dc3af68d 2023-03-22 17:54:10,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:10,381 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:10,383 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:10,391 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:10,392 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47074, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:10,402 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6f53d8eef3ff4a95bcdeb42d1836216f first=Optional[r3] last=Optional[r6] 2023-03-22 17:54:10,403 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6f53d8eef3ff4a95bcdeb42d1836216f}] 2023-03-22 17:54:10,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6f53d8eef3ff4a95bcdeb42d1836216f for inclusion in 92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-22 17:54:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:10,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6f53d8eef3ff4a95bcdeb42d1836216f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ld3058gep9mn6oojiqfvongulr2rg5rlmgn25br5m3kidgat0556ksj23uk64rl2/family1/6f53d8eef3ff4a95bcdeb42d1836216f 2023-03-22 17:54:10,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ld3058gep9mn6oojiqfvongulr2rg5rlmgn25br5m3kidgat0556ksj23uk64rl2/family1/6f53d8eef3ff4a95bcdeb42d1836216f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_ 2023-03-22 17:54:10,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ld3058gep9mn6oojiqfvongulr2rg5rlmgn25br5m3kidgat0556ksj23uk64rl2/family1/6f53d8eef3ff4a95bcdeb42d1836216f into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_ - updating store file list. 2023-03-22 17:54:10,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_ into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:10,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ld3058gep9mn6oojiqfvongulr2rg5rlmgn25br5m3kidgat0556ksj23uk64rl2/family1/6f53d8eef3ff4a95bcdeb42d1836216f into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_) 2023-03-22 17:54:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ld3058gep9mn6oojiqfvongulr2rg5rlmgn25br5m3kidgat0556ksj23uk64rl2/family1/6f53d8eef3ff4a95bcdeb42d1836216f 2023-03-22 17:54:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:54:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:54:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 92f6a8c69f04feb2c2e2175aa2fcf487/family1 is initiating minor compaction 2023-03-22 17:54:10,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@53da36e8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:10,432 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 92f6a8c69f04feb2c2e2175aa2fcf487/family1 in testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:10,432 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp, totalSize=50.0 K 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1a82f6003bb14bf08501fbb081ac0032, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 37685acdd36348709624080d11cb2d06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting ef872fa816bd4a3a95eb57b6c91ecdae, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting b625aaed3f424cd185260510ed33f1ae, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1e5339e551c24b58b355bc262893466d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 44b20f222d504fdda27854b75e09434b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 3c03b3a7c02541bb83c19638748ea789, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting a4cb8662f09a411db152a5a62a065a67, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 23ed0e79d7e54b62b45ede57eecdd994, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:54:10,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 4d76a977234445cc94c4bd8ee394ecef_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:54:10,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:10,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:10,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc8fb95fbb064838bcd547bf752d419d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc8fb95fbb064838bcd547bf752d419d 2023-03-22 17:54:10,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef8273c480744e7592f56c9229187c5e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef8273c480744e7592f56c9229187c5e 2023-03-22 17:54:10,440 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a6686bad968f4c70bee503c8d95d0436 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a6686bad968f4c70bee503c8d95d0436 2023-03-22 17:54:10,442 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1f361ad3bc14c879133c4d20258a45b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1f361ad3bc14c879133c4d20258a45b 2023-03-22 17:54:10,442 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-22 17:54:10,442 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:10,465 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 92f6a8c69f04feb2c2e2175aa2fcf487#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:11,280 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120526da9d80ab274ffb946b85e0c3d3fd1a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120526da9d80ab274ffb946b85e0c3d3fd1a 2023-03-22 17:54:11,281 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:11,283 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/31bf5796c01b427c885c3ac682b01c8e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/31bf5796c01b427c885c3ac682b01c8e 2023-03-22 17:54:11,288 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 92f6a8c69f04feb2c2e2175aa2fcf487/family1 of 92f6a8c69f04feb2c2e2175aa2fcf487 into 31bf5796c01b427c885c3ac682b01c8e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:11,288 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:11,289 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679507650432; duration=0sec 2023-03-22 17:54:11,289 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:11,305 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/602a6fd9e9a14aac8245a4edbf725e5e first=Optional[r1] last=Optional[r2] 2023-03-22 17:54:11,306 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/602a6fd9e9a14aac8245a4edbf725e5e}] 2023-03-22 17:54:11,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/602a6fd9e9a14aac8245a4edbf725e5e for inclusion in 92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:11,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-22 17:54:11,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:11,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:11,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/602a6fd9e9a14aac8245a4edbf725e5e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4h57omlu2ord2eedp7nidqas2ulsssuoisrdobbo05mr4n8ipmnalb9vkqeg2ncp/family1/602a6fd9e9a14aac8245a4edbf725e5e 2023-03-22 17:54:11,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4h57omlu2ord2eedp7nidqas2ulsssuoisrdobbo05mr4n8ipmnalb9vkqeg2ncp/family1/602a6fd9e9a14aac8245a4edbf725e5e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_ 2023-03-22 17:54:11,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4h57omlu2ord2eedp7nidqas2ulsssuoisrdobbo05mr4n8ipmnalb9vkqeg2ncp/family1/602a6fd9e9a14aac8245a4edbf725e5e into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_ - updating store file list. 2023-03-22 17:54:11,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_ into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 2023-03-22 17:54:11,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4h57omlu2ord2eedp7nidqas2ulsssuoisrdobbo05mr4n8ipmnalb9vkqeg2ncp/family1/602a6fd9e9a14aac8245a4edbf725e5e into 92f6a8c69f04feb2c2e2175aa2fcf487/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_) 2023-03-22 17:54:11,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4h57omlu2ord2eedp7nidqas2ulsssuoisrdobbo05mr4n8ipmnalb9vkqeg2ncp/family1/602a6fd9e9a14aac8245a4edbf725e5e 2023-03-22 17:54:11,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:54:11,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:54:11,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 92f6a8c69f04feb2c2e2175aa2fcf487/family1 is initiating minor compaction (all files) 2023-03-22 17:54:11,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@79c31e1c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:11,322 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 92f6a8c69f04feb2c2e2175aa2fcf487/family1 in testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:54:11,322 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/31bf5796c01b427c885c3ac682b01c8e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp, totalSize=176.8 K 2023-03-22 17:54:11,322 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 36f9416f4e29496a9662dfbab79c8666, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:54:11,323 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 31bf5796c01b427c885c3ac682b01c8e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:54:11,323 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1e02191fff31487592af213bb31e77e5_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241570 2023-03-22 17:54:11,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:11,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:11,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015147a85183384f8c97d56a0c9c697622 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015147a85183384f8c97d56a0c9c697622 2023-03-22 17:54:11,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205caed40560fda4bbaa1761e5a89b2b9e6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205caed40560fda4bbaa1761e5a89b2b9e6 2023-03-22 17:54:11,328 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-22 17:54:11,328 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-22 17:54:11,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:11,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:11,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:11,330 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:11,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8140 sec 2023-03-22 17:54:11,339 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 92f6a8c69f04feb2c2e2175aa2fcf487#family1#compaction#35 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:11,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_] to archive 2023-03-22 17:54:11,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:11,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1a82f6003bb14bf08501fbb081ac0032 2023-03-22 17:54:11,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/37685acdd36348709624080d11cb2d06 2023-03-22 17:54:11,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/ef872fa816bd4a3a95eb57b6c91ecdae 2023-03-22 17:54:11,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/b625aaed3f424cd185260510ed33f1ae 2023-03-22 17:54:11,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e5339e551c24b58b355bc262893466d 2023-03-22 17:54:11,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/44b20f222d504fdda27854b75e09434b 2023-03-22 17:54:11,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/3c03b3a7c02541bb83c19638748ea789 2023-03-22 17:54:11,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/a4cb8662f09a411db152a5a62a065a67 2023-03-22 17:54:11,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/23ed0e79d7e54b62b45ede57eecdd994 2023-03-22 17:54:11,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/4d76a977234445cc94c4bd8ee394ecef_SeqId_44_ 2023-03-22 17:54:11,424 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256 (was 251) - Thread LEAK? -, OpenFileDescriptor=603 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 319), ProcessCount=169 (was 169), AvailableMemoryMB=6163 (was 6154) - AvailableMemoryMB LEAK? - 2023-03-22 17:54:11,435 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=256, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=169, AvailableMemoryMB=6162 2023-03-22 17:54:11,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-22 17:54:11,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:11,441 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:11,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-22 17:54:11,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:11,442 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e empty. 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a empty. 2023-03-22 17:54:11,445 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896 empty. 2023-03-22 17:54:11,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:11,446 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:11,446 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:11,446 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-22 17:54:11,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:11,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:11,854 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:11,856 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 34b5c9c5b6abd41e9a7d80e152ae4896, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:11,856 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => ef607e06cf69000c37dd9f95ef6d924a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:11,856 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => fe4a473101b583b428ed5bab81ae9d1e, NAME => 'testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:12,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 34b5c9c5b6abd41e9a7d80e152ae4896, disabling compactions & flushes 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing fe4a473101b583b428ed5bab81ae9d1e, disabling compactions & flushes 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing ef607e06cf69000c37dd9f95ef6d924a, disabling compactions & flushes 2023-03-22 17:54:12,267 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,267 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. after waiting 0 ms 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,267 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,267 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for fe4a473101b583b428ed5bab81ae9d1e: 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,268 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. after waiting 0 ms 2023-03-22 17:54:12,268 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,267 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. after waiting 0 ms 2023-03-22 17:54:12,268 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,268 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,268 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,268 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:12,268 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for ef607e06cf69000c37dd9f95ef6d924a: 2023-03-22 17:54:12,270 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:12,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507652271"}]},"ts":"1679507652271"} 2023-03-22 17:54:12,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507652271"}]},"ts":"1679507652271"} 2023-03-22 17:54:12,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679507652271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507652271"}]},"ts":"1679507652271"} 2023-03-22 17:54:12,274 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-22 17:54:12,275 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:12,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507652275"}]},"ts":"1679507652275"} 2023-03-22 17:54:12,276 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-22 17:54:12,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fe4a473101b583b428ed5bab81ae9d1e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ef607e06cf69000c37dd9f95ef6d924a, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34b5c9c5b6abd41e9a7d80e152ae4896, ASSIGN}] 2023-03-22 17:54:12,281 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ef607e06cf69000c37dd9f95ef6d924a, ASSIGN 2023-03-22 17:54:12,281 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34b5c9c5b6abd41e9a7d80e152ae4896, ASSIGN 2023-03-22 17:54:12,281 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fe4a473101b583b428ed5bab81ae9d1e, ASSIGN 2023-03-22 17:54:12,282 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ef607e06cf69000c37dd9f95ef6d924a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:12,282 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fe4a473101b583b428ed5bab81ae9d1e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:12,282 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34b5c9c5b6abd41e9a7d80e152ae4896, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:12,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ef607e06cf69000c37dd9f95ef6d924a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fe4a473101b583b428ed5bab81ae9d1e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=34b5c9c5b6abd41e9a7d80e152ae4896, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679507652433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507652433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507652433"}]},"ts":"1679507652433"} 2023-03-22 17:54:12,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507652433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507652433"}]},"ts":"1679507652433"} 2023-03-22 17:54:12,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507652433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507652433"}]},"ts":"1679507652433"} 2023-03-22 17:54:12,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure ef607e06cf69000c37dd9f95ef6d924a, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:12,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure fe4a473101b583b428ed5bab81ae9d1e, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:12,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 34b5c9c5b6abd41e9a7d80e152ae4896, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:12,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:12,558 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/.tmp/family1/8361e55bcb444d0f8c2ab3c96eb088a9 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/8361e55bcb444d0f8c2ab3c96eb088a9 2023-03-22 17:54:12,563 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 92f6a8c69f04feb2c2e2175aa2fcf487/family1 of 92f6a8c69f04feb2c2e2175aa2fcf487 into 8361e55bcb444d0f8c2ab3c96eb088a9(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:54:12,564 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:54:12,564 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1679507651322; duration=1sec 2023-03-22 17:54:12,564 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:12,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef607e06cf69000c37dd9f95ef6d924a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.', STARTKEY => '1', ENDKEY => '2'} 2023-03-22 17:54:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,592 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,594 DEBUG [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/family1 2023-03-22 17:54:12,594 DEBUG [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/family1 2023-03-22 17:54:12,595 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef607e06cf69000c37dd9f95ef6d924a columnFamilyName family1 2023-03-22 17:54:12,596 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] regionserver.HStore(310): Store=ef607e06cf69000c37dd9f95ef6d924a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,596 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,598 DEBUG [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/family2 2023-03-22 17:54:12,598 DEBUG [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/family2 2023-03-22 17:54:12,598 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef607e06cf69000c37dd9f95ef6d924a columnFamilyName family2 2023-03-22 17:54:12,600 INFO [StoreOpener-ef607e06cf69000c37dd9f95ef6d924a-1] regionserver.HStore(310): Store=ef607e06cf69000c37dd9f95ef6d924a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:12,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:54:12,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:12,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef607e06cf69000c37dd9f95ef6d924a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73246211, jitterRate=0.09145359694957733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:12,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef607e06cf69000c37dd9f95ef6d924a: 2023-03-22 17:54:12,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a., pid=31, masterSystemTime=1679507652587 2023-03-22 17:54:12,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:12,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34b5c9c5b6abd41e9a7d80e152ae4896, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.', STARTKEY => '2', ENDKEY => ''} 2023-03-22 17:54:12,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ef607e06cf69000c37dd9f95ef6d924a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,609 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679507652609"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507652609"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507652609"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507652609"}]},"ts":"1679507652609"} 2023-03-22 17:54:12,610 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,611 DEBUG [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1 2023-03-22 17:54:12,611 DEBUG [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1 2023-03-22 17:54:12,612 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34b5c9c5b6abd41e9a7d80e152ae4896 columnFamilyName family1 2023-03-22 17:54:12,613 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] regionserver.HStore(310): Store=34b5c9c5b6abd41e9a7d80e152ae4896/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-03-22 17:54:12,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure ef607e06cf69000c37dd9f95ef6d924a, server=jenkins-hbase4.apache.org,46619,1679507617635 in 176 msec 2023-03-22 17:54:12,613 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ef607e06cf69000c37dd9f95ef6d924a, ASSIGN in 334 msec 2023-03-22 17:54:12,614 DEBUG [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family2 2023-03-22 17:54:12,614 DEBUG [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family2 2023-03-22 17:54:12,615 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34b5c9c5b6abd41e9a7d80e152ae4896 columnFamilyName family2 2023-03-22 17:54:12,616 INFO [StoreOpener-34b5c9c5b6abd41e9a7d80e152ae4896-1] regionserver.HStore(310): Store=34b5c9c5b6abd41e9a7d80e152ae4896/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:12,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:54:12,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:12,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34b5c9c5b6abd41e9a7d80e152ae4896; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65597372, jitterRate=-0.02252298593521118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:12,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:12,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896., pid=33, masterSystemTime=1679507652587 2023-03-22 17:54:12,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:12,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe4a473101b583b428ed5bab81ae9d1e, NAME => 'testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.', STARTKEY => '', ENDKEY => '1'} 2023-03-22 17:54:12,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=34b5c9c5b6abd41e9a7d80e152ae4896, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652624"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507652624"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507652624"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507652624"}]},"ts":"1679507652624"} 2023-03-22 17:54:12,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:12,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,626 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,627 DEBUG [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/family1 2023-03-22 17:54:12,627 DEBUG [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/family1 2023-03-22 17:54:12,628 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe4a473101b583b428ed5bab81ae9d1e columnFamilyName family1 2023-03-22 17:54:12,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-22 17:54:12,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 34b5c9c5b6abd41e9a7d80e152ae4896, server=jenkins-hbase4.apache.org,46619,1679507617635 in 189 msec 2023-03-22 17:54:12,628 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] regionserver.HStore(310): Store=fe4a473101b583b428ed5bab81ae9d1e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,629 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34b5c9c5b6abd41e9a7d80e152ae4896, ASSIGN in 349 msec 2023-03-22 17:54:12,630 DEBUG [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/family2 2023-03-22 17:54:12,630 DEBUG [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/family2 2023-03-22 17:54:12,630 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe4a473101b583b428ed5bab81ae9d1e columnFamilyName family2 2023-03-22 17:54:12,631 INFO [StoreOpener-fe4a473101b583b428ed5bab81ae9d1e-1] regionserver.HStore(310): Store=fe4a473101b583b428ed5bab81ae9d1e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:12,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:54:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:12,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe4a473101b583b428ed5bab81ae9d1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73985870, jitterRate=0.1024753749370575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:12,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe4a473101b583b428ed5bab81ae9d1e: 2023-03-22 17:54:12,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e., pid=32, masterSystemTime=1679507652587 2023-03-22 17:54:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:12,640 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fe4a473101b583b428ed5bab81ae9d1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:12,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679507652640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507652640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507652640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507652640"}]},"ts":"1679507652640"} 2023-03-22 17:54:12,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-22 17:54:12,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure fe4a473101b583b428ed5bab81ae9d1e, server=jenkins-hbase4.apache.org,46619,1679507617635 in 205 msec 2023-03-22 17:54:12,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-22 17:54:12,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fe4a473101b583b428ed5bab81ae9d1e, ASSIGN in 364 msec 2023-03-22 17:54:12,645 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:12,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507652645"}]},"ts":"1679507652645"} 2023-03-22 17:54:12,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-22 17:54:12,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:12,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/31bf5796c01b427c885c3ac682b01c8e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_] to archive 2023-03-22 17:54:12,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2120 sec 2023-03-22 17:54:12,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:12,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/36f9416f4e29496a9662dfbab79c8666 2023-03-22 17:54:12,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/31bf5796c01b427c885c3ac682b01c8e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/31bf5796c01b427c885c3ac682b01c8e 2023-03-22 17:54:12,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/family1/1e02191fff31487592af213bb31e77e5_SeqId_47_ 2023-03-22 17:54:13,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-22 17:54:13,547 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-22 17:54:13,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:13,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,557 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-22 17:54:13,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:13,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-22 17:54:13,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-22 17:54:13,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,559 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:13,559 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:13,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:13,559 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:13,559 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:13,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-22 17:54:13,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:13,560 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. started... 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:13,561 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe4a473101b583b428ed5bab81ae9d1e: 2023-03-22 17:54:13,561 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. started... 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:13,561 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. started... 2023-03-22 17:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:13,562 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 34b5c9c5b6abd41e9a7d80e152ae4896 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-22 17:54:13,562 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ef607e06cf69000c37dd9f95ef6d924a: 2023-03-22 17:54:13,563 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:13,977 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303220230a5a3dba84dacace28d39678beaf4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303220230a5a3dba84dacace28d39678beaf4 2023-03-22 17:54:14,383 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp/family1/e8b4ff54490b48b3b04caf22c332394c 2023-03-22 17:54:14,390 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp/family1/e8b4ff54490b48b3b04caf22c332394c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c 2023-03-22 17:54:14,395 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c, entries=1, sequenceid=5, filesize=4.9 K 2023-03-22 17:54:14,397 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 34b5c9c5b6abd41e9a7d80e152ae4896 in 835ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:14,397 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-22 17:54:14,397 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:14,397 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:14,397 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-22 17:54:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-22 17:54:14,400 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,400 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,401 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,401 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-22 17:54:14,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bb30ac7[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:14,402 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-22 17:54:14,402 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,404 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-22 17:54:14,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-22 17:54:14,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:14,404 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,404 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:14,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-22 17:54:14,406 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:14,405 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,406 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-22 17:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:14,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-22 17:54:14,415 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-22 17:54:14,415 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:14,415 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:14,415 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,415 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:14,418 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,418 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:14,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,418 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:14,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:14,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,422 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,430 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:14,430 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:14,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:14,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:14,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:14,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,433 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,433 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:14,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-22 17:54:14,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:14,434 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:14,434 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:14,534 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:14,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:14,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:14,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:14,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,554 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-22 17:54:14,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:14,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-22 17:54:14,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-22 17:54:14,555 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,555 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,556 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:14,556 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:14,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:14,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,558 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-22 17:54:14,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,558 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-22 17:54:14,558 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:14,558 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-22 17:54:14,560 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:14,560 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. started... 2023-03-22 17:54:14,560 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe4a473101b583b428ed5bab81ae9d1e: 2023-03-22 17:54:14,560 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:54:14,563 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:14,564 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. started... 2023-03-22 17:54:14,564 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 34b5c9c5b6abd41e9a7d80e152ae4896 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-22 17:54:14,564 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:14,564 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:14,564 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:14,564 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:14,564 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. started... 2023-03-22 17:54:14,565 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for ef607e06cf69000c37dd9f95ef6d924a: 2023-03-22 17:54:14,565 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:54:14,565 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:14,625 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322ca90251a4050498e9b05874d603d35c9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230322ca90251a4050498e9b05874d603d35c9 2023-03-22 17:54:14,644 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp/family1/da0539a9c766465bbd7b9ffd24fc4834 2023-03-22 17:54:14,651 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp/family1/da0539a9c766465bbd7b9ffd24fc4834 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834 2023-03-22 17:54:14,659 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834, entries=2, sequenceid=9, filesize=5.0 K 2023-03-22 17:54:14,660 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 34b5c9c5b6abd41e9a7d80e152ae4896 in 96ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:14,661 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:14,661 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-22 17:54:14,661 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-22 17:54:14,663 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:14,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-22 17:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c696c28[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:14,665 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-22 17:54:14,665 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,667 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,667 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:14,668 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,668 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-22 17:54:14,668 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-22 17:54:14,668 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:14,670 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,670 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-22 17:54:14,671 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:14,671 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-22 17:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:14,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-22 17:54:14,673 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-22 17:54:14,673 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:14,674 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:14,674 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,674 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:14,677 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,677 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:14,677 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:14,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,678 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:14,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,679 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:14,683 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:14,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:14,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:14,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:14,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:14,688 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:14,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-22 17:54:14,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:14,688 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:14,688 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:14,789 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:14,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:14,800 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-22 17:54:14,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-22 17:54:14,804 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-22 17:54:14,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:14,805 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508254805 2023-03-22 17:54:14,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:14,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-22 17:54:14,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-22 17:54:14,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x4a6cc2e6 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:14,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2702d6be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:14,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230322 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-22 17:54:15,682 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032240e3dd99e7db456396ccb18bf379a2dc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023032240e3dd99e7db456396ccb18bf379a2dc 2023-03-22 17:54:15,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-22 17:54:15,703 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:15,705 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:15,720 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:15,723 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:15,754 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230322/family1/b21843e9aa6f4eefa4931592166fb6c5 first=Optional[k0] last=Optional[k1] 2023-03-22 17:54:15,755 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230322/family1/b21843e9aa6f4eefa4931592166fb6c5}] 2023-03-22 17:54:15,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230322/family1/b21843e9aa6f4eefa4931592166fb6c5 for inclusion in 34b5c9c5b6abd41e9a7d80e152ae4896/family1 2023-03-22 17:54:15,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-22 17:54:15,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-22 17:54:15,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:15,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230322/family1/b21843e9aa6f4eefa4931592166fb6c5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbcab9ljd0mvk2d6ieq0hb7i09ccjlt02ro0pkthfuorrmug8u7k6dogls1konjd/family1/b21843e9aa6f4eefa4931592166fb6c5 2023-03-22 17:54:15,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbcab9ljd0mvk2d6ieq0hb7i09ccjlt02ro0pkthfuorrmug8u7k6dogls1konjd/family1/b21843e9aa6f4eefa4931592166fb6c5 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_ 2023-03-22 17:54:15,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbcab9ljd0mvk2d6ieq0hb7i09ccjlt02ro0pkthfuorrmug8u7k6dogls1konjd/family1/b21843e9aa6f4eefa4931592166fb6c5 into 34b5c9c5b6abd41e9a7d80e152ae4896/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_ - updating store file list. 2023-03-22 17:54:15,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_ into 34b5c9c5b6abd41e9a7d80e152ae4896/family1 2023-03-22 17:54:15,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbcab9ljd0mvk2d6ieq0hb7i09ccjlt02ro0pkthfuorrmug8u7k6dogls1konjd/family1/b21843e9aa6f4eefa4931592166fb6c5 into 34b5c9c5b6abd41e9a7d80e152ae4896/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_) 2023-03-22 17:54:15,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbcab9ljd0mvk2d6ieq0hb7i09ccjlt02ro0pkthfuorrmug8u7k6dogls1konjd/family1/b21843e9aa6f4eefa4931592166fb6c5 2023-03-22 17:54:15,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:54:15,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:54:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 34b5c9c5b6abd41e9a7d80e152ae4896/family1 is initiating minor compaction (all files) 2023-03-22 17:54:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5dc82613; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:15,800 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 34b5c9c5b6abd41e9a7d80e152ae4896/family1 in testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:54:15,800 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp, totalSize=15.1 K 2023-03-22 17:54:15,801 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting e8b4ff54490b48b3b04caf22c332394c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507653548 2023-03-22 17:54:15,801 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting da0539a9c766465bbd7b9ffd24fc4834, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507653548 2023-03-22 17:54:15,802 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting d597f0a4ae944631bb8489115d97ca3d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507653548 2023-03-22 17:54:15,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-22 17:54:15,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:15,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303220230a5a3dba84dacace28d39678beaf4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303220230a5a3dba84dacace28d39678beaf4 2023-03-22 17:54:15,816 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230322ca90251a4050498e9b05874d603d35c9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230322ca90251a4050498e9b05874d603d35c9 2023-03-22 17:54:15,816 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-22 17:54:15,816 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230322' 2023-03-22 17:54:15,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230322 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-22 17:54:15,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-22 17:54:15,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:15,821 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-22 17:54:15,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 1.0190 sec 2023-03-22 17:54:15,835 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 34b5c9c5b6abd41e9a7d80e152ae4896#family1#compaction#38 average throughput is 0.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:15,880 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257 (was 256) - Thread LEAK? -, OpenFileDescriptor=607 (was 603) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=328 (was 278) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6132 (was 6162) 2023-03-22 17:54:15,898 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=328, ProcessCount=169, AvailableMemoryMB=6132 2023-03-22 17:54:15,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:54:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:15,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:15,908 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:15,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-22 17:54:15,910 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:15,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:15,911 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be empty. 2023-03-22 17:54:15,911 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:15,911 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-22 17:54:16,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:16,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:16,332 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:16,334 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5f1ba5448b3f743247bcb076351a8be, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:16,742 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:16,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing b5f1ba5448b3f743247bcb076351a8be, disabling compactions & flushes 2023-03-22 17:54:16,743 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:16,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:16,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. after waiting 0 ms 2023-03-22 17:54:16,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:16,743 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:16,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:16,746 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:16,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507656748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507656748"}]},"ts":"1679507656748"} 2023-03-22 17:54:16,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:54:16,751 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:16,751 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507656751"}]},"ts":"1679507656751"} 2023-03-22 17:54:16,752 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-22 17:54:16,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5f1ba5448b3f743247bcb076351a8be, ASSIGN}] 2023-03-22 17:54:16,758 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5f1ba5448b3f743247bcb076351a8be, ASSIGN 2023-03-22 17:54:16,759 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5f1ba5448b3f743247bcb076351a8be, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:16,910 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5f1ba5448b3f743247bcb076351a8be, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:16,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507656910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507656910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507656910"}]},"ts":"1679507656910"} 2023-03-22 17:54:16,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure b5f1ba5448b3f743247bcb076351a8be, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:17,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:17,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5f1ba5448b3f743247bcb076351a8be, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,072 INFO [StoreOpener-b5f1ba5448b3f743247bcb076351a8be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,074 DEBUG [StoreOpener-b5f1ba5448b3f743247bcb076351a8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:17,074 DEBUG [StoreOpener-b5f1ba5448b3f743247bcb076351a8be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:17,074 INFO [StoreOpener-b5f1ba5448b3f743247bcb076351a8be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5f1ba5448b3f743247bcb076351a8be columnFamilyName family1 2023-03-22 17:54:17,078 INFO [StoreOpener-b5f1ba5448b3f743247bcb076351a8be-1] regionserver.HStore(310): Store=b5f1ba5448b3f743247bcb076351a8be/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:17,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,083 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/.tmp/family1/208103a0bef54850a44ee5cbb64c4886 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/208103a0bef54850a44ee5cbb64c4886 2023-03-22 17:54:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:54:17,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:17,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5f1ba5448b3f743247bcb076351a8be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61602040, jitterRate=-0.08205807209014893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:17,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be., pid=37, masterSystemTime=1679507657064 2023-03-22 17:54:17,095 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 34b5c9c5b6abd41e9a7d80e152ae4896/family1 of 34b5c9c5b6abd41e9a7d80e152ae4896 into 208103a0bef54850a44ee5cbb64c4886(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:54:17,095 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:54:17,095 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1679507655800; duration=1sec 2023-03-22 17:54:17,095 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:17,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:17,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:17,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b5f1ba5448b3f743247bcb076351a8be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:17,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679507657097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507657097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507657097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507657097"}]},"ts":"1679507657097"} 2023-03-22 17:54:17,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-22 17:54:17,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure b5f1ba5448b3f743247bcb076351a8be, server=jenkins-hbase4.apache.org,46619,1679507617635 in 187 msec 2023-03-22 17:54:17,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-22 17:54:17,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=b5f1ba5448b3f743247bcb076351a8be, ASSIGN in 345 msec 2023-03-22 17:54:17,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:17,104 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507657104"}]},"ts":"1679507657104"} 2023-03-22 17:54:17,105 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-22 17:54:17,107 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:17,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2050 sec 2023-03-22 17:54:17,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_] to archive 2023-03-22 17:54:17,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:17,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/e8b4ff54490b48b3b04caf22c332394c 2023-03-22 17:54:17,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/da0539a9c766465bbd7b9ffd24fc4834 2023-03-22 17:54:17,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/family1/d597f0a4ae944631bb8489115d97ca3d_SeqId_12_ 2023-03-22 17:54:18,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-22 17:54:18,017 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-22 17:54:18,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:18,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,063 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:18,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:18,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:18,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:18,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,065 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:18,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:18,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,067 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,068 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,068 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:18,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:18,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:18,072 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:18,072 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:18,073 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:54:18,127 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:18,511 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308985b7907b8744db9a9a1545d02a8619 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308985b7907b8744db9a9a1545d02a8619 2023-03-22 17:54:18,916 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/259798c1387e4a86a461627795b6bc09 2023-03-22 17:54:18,926 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/259798c1387e4a86a461627795b6bc09 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/259798c1387e4a86a461627795b6bc09 2023-03-22 17:54:18,932 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/259798c1387e4a86a461627795b6bc09, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-22 17:54:18,933 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 860ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:18,933 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:18,934 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:18,934 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:18,934 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:18,934 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,934 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:18,934 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:18,936 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:18,936 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:18,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:18,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a539f20[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:18,938 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:18,938 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,941 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:18,941 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,941 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:18,942 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:18,943 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:18,943 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:18,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:18,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:18,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:18,946 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:18,946 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:18,946 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:18,946 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,946 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:18,947 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,947 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,947 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:18,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:18,948 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,950 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,952 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,952 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,952 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:18,953 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:18,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:18,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:18,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:18,953 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:19,053 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:19,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:19,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:19,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:19,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,063 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:19,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:19,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:19,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:19,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,065 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:19,065 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:19,066 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,066 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,067 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:19,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:19,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:19,072 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:19,072 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:19,072 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:54:19,102 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112816ce087248184705b81a1f1cb782f8e7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112816ce087248184705b81a1f1cb782f8e7 2023-03-22 17:54:19,517 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/ecf3bc28a25d487e8ce294bc1f5ff949 2023-03-22 17:54:19,530 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/ecf3bc28a25d487e8ce294bc1f5ff949 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949 2023-03-22 17:54:19,536 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:54:19,537 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 465ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:19,537 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:19,538 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:19,538 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:19,539 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,539 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:19,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:19,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710822a[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:19,542 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:19,542 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,543 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,543 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:19,543 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:19,543 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:19,544 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,544 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:19,551 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,551 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:19,551 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:19,551 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:19,554 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:19,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:19,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:19,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:19,554 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,554 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:19,556 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,556 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,556 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:19,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:19,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:19,557 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,558 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:19,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,561 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:19,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:19,561 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:19,561 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:19,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:19,561 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:19,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:19,561 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:19,562 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:19,662 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:19,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:19,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:19,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:19,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,670 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:19,670 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:19,670 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:19,671 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:19,671 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,671 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,672 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,672 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:19,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:19,673 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:19,673 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:19,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:19,676 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:19,676 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:19,676 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:19,676 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:19,676 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:19,677 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:19,677 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:19,677 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:20,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201aa6ae3fae6a44077816f29663432ae14 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201aa6ae3fae6a44077816f29663432ae14 2023-03-22 17:54:20,106 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/2ecbfebf344d4ac5b3d7cd87a03ef442 2023-03-22 17:54:20,111 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/2ecbfebf344d4ac5b3d7cd87a03ef442 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442 2023-03-22 17:54:20,115 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442, entries=1, sequenceid=13, filesize=4.9 K 2023-03-22 17:54:20,116 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 439ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:20,116 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:20,116 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:20,117 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:20,118 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,118 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:20,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6496453d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:20,121 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:20,121 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,126 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,126 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:20,126 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:20,126 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:20,126 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,126 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:20,127 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:20,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:20,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:20,130 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:20,130 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:20,130 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:20,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,131 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:20,132 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,132 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,132 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:20,133 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,135 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:20,140 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:20,140 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:20,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:20,140 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:20,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:20,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:20,140 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:20,141 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:20,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:20,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:20,241 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:20,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,248 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:20,248 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:20,248 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:20,248 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:20,248 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,249 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,250 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:20,250 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:20,250 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,251 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,252 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:20,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,252 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:20,252 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:20,252 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:20,253 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:20,253 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:20,253 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:20,254 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:20,254 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:20,267 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056256272395e846fd925db1bb6bb3da0a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056256272395e846fd925db1bb6bb3da0a 2023-03-22 17:54:20,273 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/a92bea6d373e47d9919e827fd964a8d8 2023-03-22 17:54:20,277 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/a92bea6d373e47d9919e827fd964a8d8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8 2023-03-22 17:54:20,281 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8, entries=1, sequenceid=17, filesize=4.9 K 2023-03-22 17:54:20,282 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 28ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:20,282 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:20,282 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:20,282 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:20,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:20,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:20,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:20,284 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,284 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,285 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,285 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:20,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63197dab[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:20,286 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:20,286 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,288 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,288 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:20,288 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:20,288 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:20,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:20,290 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:20,290 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:20,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:20,292 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:20,292 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:20,292 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:20,292 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,292 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:20,294 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,294 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:20,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,294 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:20,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:20,295 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:20,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,300 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:20,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:20,303 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,303 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:20,304 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:20,304 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:20,404 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:20,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:20,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:20,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:20,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,412 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:20,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:20,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:20,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:20,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,412 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,415 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:20,415 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:20,416 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:20,416 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,417 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,417 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:20,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:20,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:20,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:20,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:20,417 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:20,418 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:20,418 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:20,418 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:20,872 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283c49d0b18a99475d8a8402403ef05ae4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512283c49d0b18a99475d8a8402403ef05ae4 2023-03-22 17:54:21,283 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/b348934625024c5b91fdbd2d4ddea859 2023-03-22 17:54:21,291 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/b348934625024c5b91fdbd2d4ddea859 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859 2023-03-22 17:54:21,298 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859, entries=1, sequenceid=21, filesize=4.9 K 2023-03-22 17:54:21,300 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 882ms, sequenceid=21, compaction requested=true 2023-03-22 17:54:21,300 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:21,300 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:21,300 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:21,300 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:21,300 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,300 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:21,300 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:21,304 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,304 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:21,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:21,305 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,305 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:21,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:21,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:21,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b54477[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:21,307 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:21,308 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,309 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:21,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:21,309 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:21,313 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:21,313 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:21,313 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,313 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:21,314 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:21,314 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:21,314 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:21,314 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:21,314 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:21,314 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,314 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:21,319 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,319 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,319 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:21,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:21,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:21,321 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,323 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,333 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:21,333 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:21,333 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:21,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:21,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:21,333 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:21,333 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,334 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,333 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:21,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:21,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:21,434 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:21,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:21,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:21,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:21,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,447 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:21,447 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:21,447 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:21,447 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:21,448 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,448 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,449 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:21,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,450 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,450 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:21,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,451 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,451 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:21,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:21,464 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:21,465 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:21,465 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:21,494 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c1a160870d7447d5b213a175c93f2b8a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1a160870d7447d5b213a175c93f2b8a 2023-03-22 17:54:21,537 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:21,537 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a6cc2e6 to 127.0.0.1:60739 2023-03-22 17:54:21,537 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:21,537 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:21,537 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47be990d to 127.0.0.1:60739 2023-03-22 17:54:21,537 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:21,538 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:21,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x729e59a9 to 127.0.0.1:60739 2023-03-22 17:54:21,538 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:21,955 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/177f3b9af36441c284e37956b412cb53 2023-03-22 17:54:21,975 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/177f3b9af36441c284e37956b412cb53 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53 2023-03-22 17:54:21,981 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53, entries=1, sequenceid=25, filesize=4.9 K 2023-03-22 17:54:21,982 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 517ms, sequenceid=25, compaction requested=true 2023-03-22 17:54:21,982 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:21,982 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:21,984 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,984 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:21,985 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,985 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:21,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:21,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b79b39[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:21,987 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:21,987 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,988 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,988 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:21,988 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:21,988 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,988 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:21,988 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:21,991 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:21,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:21,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:21,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:21,997 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:21,997 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:21,997 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:21,997 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,997 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:21,999 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,999 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:21,999 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:22,001 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,003 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,005 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:22,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:22,006 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:22,006 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:22,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:22,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:22,006 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:22,007 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:22,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:22,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:22,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:22,108 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:22,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:22,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:22,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:22,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,115 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:22,115 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:22,115 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:22,115 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:22,116 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,116 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,119 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:22,119 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:22,119 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,119 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:22,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,121 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:22,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:22,121 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:22,121 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:22,121 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:22,121 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:22,534 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012898f50d1c754adc9ec31f126d3505fc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012898f50d1c754adc9ec31f126d3505fc 2023-03-22 17:54:22,940 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/5ed3f6453ef5403391d678ae66ecf48b 2023-03-22 17:54:22,949 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/5ed3f6453ef5403391d678ae66ecf48b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b 2023-03-22 17:54:22,954 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b, entries=1, sequenceid=29, filesize=4.9 K 2023-03-22 17:54:22,955 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 834ms, sequenceid=29, compaction requested=true 2023-03-22 17:54:22,955 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:22,955 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:22,963 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,963 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:22,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:22,964 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,964 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:22,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:22,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:22,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:22,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@305e857f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:22,965 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:22,965 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,967 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,967 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:22,967 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,967 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:22,967 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:22,967 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:22,968 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:22,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:22,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:22,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:22,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:22,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:22,971 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:22,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:22,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:22,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,971 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:22,972 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,972 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:22,972 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:22,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:22,973 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:22,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,974 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,979 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,979 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:22,979 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:22,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:22,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,980 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:22,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:22,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:22,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:22,980 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,080 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:23,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:23,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:23,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:23,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,088 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:23,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:23,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,089 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,090 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,090 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:23,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:23,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:23,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:23,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:23,091 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,091 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:23,091 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:23,106 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103099817fb4a354700b44cbecd18de81e6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103099817fb4a354700b44cbecd18de81e6 2023-03-22 17:54:23,113 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/478b1e7052ca49dba39c6c92a52cccd3 2023-03-22 17:54:23,121 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/478b1e7052ca49dba39c6c92a52cccd3 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3 2023-03-22 17:54:23,125 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3, entries=1, sequenceid=33, filesize=4.9 K 2023-03-22 17:54:23,127 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 36ms, sequenceid=33, compaction requested=true 2023-03-22 17:54:23,127 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:23,127 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:23,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:23,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:23,127 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:23,129 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,129 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,130 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,130 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:23,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:23,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@180252fa[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:23,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:23,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,133 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:23,133 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:23,133 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:23,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:23,135 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,135 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:23,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:23,138 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:23,138 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:23,138 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:23,138 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,138 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:23,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,139 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,140 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,141 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:23,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:23,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,144 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,144 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,145 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:23,145 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:23,245 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:23,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:23,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:23,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:23,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,252 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,252 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,252 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:23,252 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:23,252 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,253 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,254 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,254 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,254 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,254 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:23,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,263 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:23,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,263 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:23,263 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,263 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:23,263 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:23,263 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:23,263 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,263 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:23,263 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:23,278 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b36939d85a6c4151af869464f11d5212 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907b36939d85a6c4151af869464f11d5212 2023-03-22 17:54:23,685 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/ea12ff681a17475d8df72cc334a1dded 2023-03-22 17:54:23,691 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/ea12ff681a17475d8df72cc334a1dded as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded 2023-03-22 17:54:23,696 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded, entries=1, sequenceid=37, filesize=4.9 K 2023-03-22 17:54:23,697 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 434ms, sequenceid=37, compaction requested=true 2023-03-22 17:54:23,697 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:23,697 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:23,700 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,700 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:23,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@575b2b71[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:23,702 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:23,702 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,703 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:23,704 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,704 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:23,705 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,705 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:23,705 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,705 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:23,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:23,709 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:23,709 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:23,709 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:23,709 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,709 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:23,710 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,710 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,710 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,711 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,712 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:23,717 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:23,716 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,716 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,817 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:23,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:23,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:23,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:23,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,824 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,824 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,824 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-22 17:54:23,824 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-22 17:54:23,824 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,825 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,826 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,826 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,826 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,826 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:23,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,827 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-22 17:54:23,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-22 17:54:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:23,827 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-22 17:54:23,828 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:23,828 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:23,828 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,828 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. started... 2023-03-22 17:54:23,828 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5f1ba5448b3f743247bcb076351a8be 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:23,841 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e5ec93db353448b1bee8c42f1ca2b70a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120e5ec93db353448b1bee8c42f1ca2b70a 2023-03-22 17:54:23,847 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/9a892fab526e4da684e1a4579cd16d4b 2023-03-22 17:54:23,853 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/9a892fab526e4da684e1a4579cd16d4b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b 2023-03-22 17:54:23,858 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b, entries=1, sequenceid=41, filesize=4.9 K 2023-03-22 17:54:23,859 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f1ba5448b3f743247bcb076351a8be in 31ms, sequenceid=41, compaction requested=true 2023-03-22 17:54:23,859 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:23,859 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-22 17:54:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-22 17:54:23,861 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-22 17:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@def1cf0[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:23,864 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-22 17:54:23,864 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,865 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-22 17:54:23,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-22 17:54:23,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:23,866 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,866 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:23,869 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-22 17:54:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-22 17:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:23,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:54:23,872 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-22 17:54:23,872 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:23,872 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:23,872 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,872 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:23,874 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,874 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,874 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:23,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,875 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,876 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:23,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:23,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:23,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:23,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-22 17:54:23,882 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:23,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-22 17:54:23,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:23,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:23,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:23,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:23,883 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:23,983 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:23,986 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-22 17:54:23,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:23,989 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:23,990 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508263990 2023-03-22 17:54:23,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:23,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:23,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-22 17:54:23,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:23,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x512733a0 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:24,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60a1a81c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:24,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,491 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010333caeb883aef41fc9bfb65e97e0e97bd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010333caeb883aef41fc9bfb65e97e0e97bd 2023-03-22 17:54:24,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:24,511 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:24,512 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:24,520 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:24,521 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:24,531 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7b9c4d41bdc44a05923631f208d0a4cc first=Optional[r3] last=Optional[r6] 2023-03-22 17:54:24,532 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7b9c4d41bdc44a05923631f208d0a4cc}] 2023-03-22 17:54:24,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7b9c4d41bdc44a05923631f208d0a4cc for inclusion in b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-22 17:54:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:24,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:24,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7b9c4d41bdc44a05923631f208d0a4cc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8e8j83ril9dib9ae1su04715ki6jveaa0srbfr9l9ivc260qke08ge69dmm2aj6a/family1/7b9c4d41bdc44a05923631f208d0a4cc 2023-03-22 17:54:24,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8e8j83ril9dib9ae1su04715ki6jveaa0srbfr9l9ivc260qke08ge69dmm2aj6a/family1/7b9c4d41bdc44a05923631f208d0a4cc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_ 2023-03-22 17:54:24,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8e8j83ril9dib9ae1su04715ki6jveaa0srbfr9l9ivc260qke08ge69dmm2aj6a/family1/7b9c4d41bdc44a05923631f208d0a4cc into b5f1ba5448b3f743247bcb076351a8be/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_ - updating store file list. 2023-03-22 17:54:24,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_ into b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:24,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8e8j83ril9dib9ae1su04715ki6jveaa0srbfr9l9ivc260qke08ge69dmm2aj6a/family1/7b9c4d41bdc44a05923631f208d0a4cc into b5f1ba5448b3f743247bcb076351a8be/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_) 2023-03-22 17:54:24,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8e8j83ril9dib9ae1su04715ki6jveaa0srbfr9l9ivc260qke08ge69dmm2aj6a/family1/7b9c4d41bdc44a05923631f208d0a4cc 2023-03-22 17:54:24,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:54:24,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:54:24,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): b5f1ba5448b3f743247bcb076351a8be/family1 is initiating minor compaction 2023-03-22 17:54:24,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6dd3d484; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:24,551 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5f1ba5448b3f743247bcb076351a8be/family1 in testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:54:24,551 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp, totalSize=50.0 K 2023-03-22 17:54:24,551 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting ecf3bc28a25d487e8ce294bc1f5ff949, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:54:24,551 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2ecbfebf344d4ac5b3d7cd87a03ef442, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:54:24,551 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting a92bea6d373e47d9919e827fd964a8d8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:54:24,551 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting b348934625024c5b91fdbd2d4ddea859, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 177f3b9af36441c284e37956b412cb53, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5ed3f6453ef5403391d678ae66ecf48b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 478b1e7052ca49dba39c6c92a52cccd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting ea12ff681a17475d8df72cc334a1dded, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 9a892fab526e4da684e1a4579cd16d4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:54:24,552 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:54:24,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:24,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:24,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512283c49d0b18a99475d8a8402403ef05ae4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512283c49d0b18a99475d8a8402403ef05ae4 2023-03-22 17:54:24,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1a160870d7447d5b213a175c93f2b8a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1a160870d7447d5b213a175c93f2b8a 2023-03-22 17:54:24,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012898f50d1c754adc9ec31f126d3505fc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012898f50d1c754adc9ec31f126d3505fc 2023-03-22 17:54:24,561 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103099817fb4a354700b44cbecd18de81e6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103099817fb4a354700b44cbecd18de81e6 2023-03-22 17:54:24,561 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-22 17:54:24,561 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,591 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5f1ba5448b3f743247bcb076351a8be#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:24,634 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205704d960d14324c528e507dd56a8a160b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205704d960d14324c528e507dd56a8a160b 2023-03-22 17:54:24,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:24,673 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 first=Optional[r00] last=Optional[r2] 2023-03-22 17:54:24,674 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d73a0494c2f4d8ba4ed409d81bf63a5}] 2023-03-22 17:54:24,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 for inclusion in b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:24,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-22 17:54:24,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:24,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:24,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n5svgomfojc3bekk55l59g40i5t82fei6t9vhucp0fh9tj1eifo4triin1sukmvf/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 2023-03-22 17:54:24,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n5svgomfojc3bekk55l59g40i5t82fei6t9vhucp0fh9tj1eifo4triin1sukmvf/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/c44fab7b20b143ffb8b0951bc3227bd7_SeqId_46_ 2023-03-22 17:54:24,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n5svgomfojc3bekk55l59g40i5t82fei6t9vhucp0fh9tj1eifo4triin1sukmvf/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 into b5f1ba5448b3f743247bcb076351a8be/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/c44fab7b20b143ffb8b0951bc3227bd7_SeqId_46_ - updating store file list. 2023-03-22 17:54:24,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/c44fab7b20b143ffb8b0951bc3227bd7_SeqId_46_ into b5f1ba5448b3f743247bcb076351a8be/family1 2023-03-22 17:54:24,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n5svgomfojc3bekk55l59g40i5t82fei6t9vhucp0fh9tj1eifo4triin1sukmvf/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 into b5f1ba5448b3f743247bcb076351a8be/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/c44fab7b20b143ffb8b0951bc3227bd7_SeqId_46_) 2023-03-22 17:54:24,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyPolicy__n5svgomfojc3bekk55l59g40i5t82fei6t9vhucp0fh9tj1eifo4triin1sukmvf/family1/1d73a0494c2f4d8ba4ed409d81bf63a5 2023-03-22 17:54:24,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:24,690 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:24,692 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308985b7907b8744db9a9a1545d02a8619 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308985b7907b8744db9a9a1545d02a8619 2023-03-22 17:54:24,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201aa6ae3fae6a44077816f29663432ae14 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201aa6ae3fae6a44077816f29663432ae14 2023-03-22 17:54:24,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056256272395e846fd925db1bb6bb3da0a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056256272395e846fd925db1bb6bb3da0a 2023-03-22 17:54:24,695 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-22 17:54:24,695 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-22 17:54:24,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-22 17:54:24,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-22 17:54:24,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:24,697 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:54:24,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 710 msec 2023-03-22 17:54:24,904 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264 (was 255) - Thread LEAK? -, OpenFileDescriptor=628 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 328) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6068 (was 6132) 2023-03-22 17:54:24,918 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=264, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=169, AvailableMemoryMB=6068 2023-03-22 17:54:24,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:54:24,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:24,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:24,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-22 17:54:24,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:24,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-22 17:54:24,926 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:24,927 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc empty. 2023-03-22 17:54:24,929 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:24,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-22 17:54:24,944 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:24,946 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7eaae50c2de027d9af0c25b2dce0ffdc, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:25,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-22 17:54:25,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-22 17:54:25,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:25,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 7eaae50c2de027d9af0c25b2dce0ffdc, disabling compactions & flushes 2023-03-22 17:54:25,352 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,352 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. after waiting 0 ms 2023-03-22 17:54:25,353 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,353 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,353 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:25,355 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:25,356 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507665356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507665356"}]},"ts":"1679507665356"} 2023-03-22 17:54:25,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:54:25,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:25,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507665359"}]},"ts":"1679507665359"} 2023-03-22 17:54:25,360 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-22 17:54:25,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, ASSIGN}] 2023-03-22 17:54:25,364 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, ASSIGN 2023-03-22 17:54:25,365 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:25,418 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/.tmp/family1/003f0c4c470f4763ab1a4161b14bdaa6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/003f0c4c470f4763ab1a4161b14bdaa6 2023-03-22 17:54:25,433 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b5f1ba5448b3f743247bcb076351a8be/family1 of b5f1ba5448b3f743247bcb076351a8be into 003f0c4c470f4763ab1a4161b14bdaa6(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:25,433 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:54:25,434 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679507664551; duration=0sec 2023-03-22 17:54:25,434 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:25,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_] to archive 2023-03-22 17:54:25,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:25,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ecf3bc28a25d487e8ce294bc1f5ff949 2023-03-22 17:54:25,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/2ecbfebf344d4ac5b3d7cd87a03ef442 2023-03-22 17:54:25,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a92bea6d373e47d9919e827fd964a8d8 2023-03-22 17:54:25,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/b348934625024c5b91fdbd2d4ddea859 2023-03-22 17:54:25,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/177f3b9af36441c284e37956b412cb53 2023-03-22 17:54:25,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/5ed3f6453ef5403391d678ae66ecf48b 2023-03-22 17:54:25,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/478b1e7052ca49dba39c6c92a52cccd3 2023-03-22 17:54:25,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/ea12ff681a17475d8df72cc334a1dded 2023-03-22 17:54:25,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/9a892fab526e4da684e1a4579cd16d4b 2023-03-22 17:54:25,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/family1/a2df3f8ba147481aa9d9c9f6ccc4125c_SeqId_44_ 2023-03-22 17:54:25,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:25,517 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507665516"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507665516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507665516"}]},"ts":"1679507665516"} 2023-03-22 17:54:25,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-22 17:54:25,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eaae50c2de027d9af0c25b2dce0ffdc, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:25,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:25,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,676 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,678 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:25,678 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:25,678 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eaae50c2de027d9af0c25b2dce0ffdc columnFamilyName family1 2023-03-22 17:54:25,679 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(310): Store=7eaae50c2de027d9af0c25b2dce0ffdc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:25,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:25,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:25,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7eaae50c2de027d9af0c25b2dce0ffdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60101567, jitterRate=-0.1044168621301651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:25,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:25,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., pid=41, masterSystemTime=1679507665670 2023-03-22 17:54:25,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:25,689 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:25,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507665689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507665689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507665689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507665689"}]},"ts":"1679507665689"} 2023-03-22 17:54:25,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-22 17:54:25,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 172 msec 2023-03-22 17:54:25,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-22 17:54:25,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, ASSIGN in 330 msec 2023-03-22 17:54:25,696 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:25,696 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507665696"}]},"ts":"1679507665696"} 2023-03-22 17:54:25,697 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-22 17:54:25,700 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:25,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 779 msec 2023-03-22 17:54:26,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-22 17:54:26,032 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-22 17:54:26,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:26,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,081 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:26,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:26,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,085 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:26,085 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:26,085 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,085 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:26,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:26,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:26,087 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:26,087 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:26,088 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:54:26,130 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300188ce2ca03a496d8ea24653d6508849 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300188ce2ca03a496d8ea24653d6508849 2023-03-22 17:54:26,136 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/d6fb3b2453144174ac9875d9743411bc 2023-03-22 17:54:26,142 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/d6fb3b2453144174ac9875d9743411bc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc 2023-03-22 17:54:26,151 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-22 17:54:26,152 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 64ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:26,152 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,153 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:26,153 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:26,153 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:26,153 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:26,153 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,153 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:26,153 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:26,155 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,155 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,156 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,156 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@495e054f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:26,157 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:26,158 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,159 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,159 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:26,159 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:26,159 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:26,159 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,159 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:26,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,161 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,161 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:26,161 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:26,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:26,163 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:26,163 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:26,163 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:26,163 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,163 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:26,166 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,166 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,166 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,166 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,167 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,170 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:26,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:26,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:26,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:26,170 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:26,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:26,271 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:26,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:26,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:26,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:26,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,279 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:26,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:26,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,281 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,281 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:26,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:26,282 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,282 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:26,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:26,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,283 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:26,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:26,284 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:26,284 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:26,284 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:54:26,703 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128302cecb9fd6f477eb15dcce2af53fe4d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128302cecb9fd6f477eb15dcce2af53fe4d 2023-03-22 17:54:26,709 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/ad205c9d02814d3a939a56b5cee76315 2023-03-22 17:54:26,716 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/ad205c9d02814d3a939a56b5cee76315 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315 2023-03-22 17:54:26,720 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:54:26,721 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 437ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:26,722 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:26,722 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:26,724 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,724 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:26,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43411b1c[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:26,726 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:26,726 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,727 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:26,728 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,728 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:26,730 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:26,731 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,731 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,731 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:26,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:26,733 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:26,733 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:26,733 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:26,733 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,733 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:26,735 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,735 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,735 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:26,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:26,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:26,736 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,738 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,744 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,744 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:26,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:26,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:26,744 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:26,744 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:26,744 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:26,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:26,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:26,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:26,844 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:26,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:26,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:26,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,852 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:26,852 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,852 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:26,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:26,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,854 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:26,854 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:26,855 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:26,855 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:26,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:26,856 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:26,856 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:26,856 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:27,278 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120186d422549cff41108b74b1c2308f1ed4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120186d422549cff41108b74b1c2308f1ed4 2023-03-22 17:54:27,688 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/ce9f8c943fce49249f6283c7c05972a1 2023-03-22 17:54:27,695 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/ce9f8c943fce49249f6283c7c05972a1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1 2023-03-22 17:54:27,699 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1, entries=1, sequenceid=13, filesize=5.0 K 2023-03-22 17:54:27,700 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 844ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:27,700 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:27,700 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:27,701 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:27,701 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,701 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:27,701 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:27,703 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,703 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:27,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dcfa0a6[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:27,706 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:27,706 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,707 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,707 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:27,707 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:27,707 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:27,708 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,708 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:27,709 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,709 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:27,709 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:27,710 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:27,714 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:27,714 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:27,714 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:27,714 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,714 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:27,717 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,717 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,717 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,718 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,720 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:27,723 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:27,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,723 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,724 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:27,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:27,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:27,724 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:27,824 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:27,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:27,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:27,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:27,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,834 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:27,834 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:27,834 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:27,834 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:27,834 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,834 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,836 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:27,836 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:27,836 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,836 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,837 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,837 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:27,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,837 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:27,838 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:27,838 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:27,838 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:27,838 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:27,839 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:27,839 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:27,839 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:27,856 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f057dc90ff4042f0ba518c429d812b4c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f057dc90ff4042f0ba518c429d812b4c 2023-03-22 17:54:27,867 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/d27f0f4515724048a43bdb24939b78b0 2023-03-22 17:54:27,873 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/d27f0f4515724048a43bdb24939b78b0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0 2023-03-22 17:54:27,878 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0, entries=1, sequenceid=17, filesize=5.0 K 2023-03-22 17:54:27,879 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 40ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:27,879 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:27,879 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:27,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:27,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:27,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:27,881 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,881 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:27,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38323d73[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:27,883 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:27,884 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,891 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,891 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:27,891 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:27,891 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:27,891 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,891 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:27,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:27,893 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:27,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:27,895 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:27,895 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:27,895 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:27,895 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,895 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:27,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:27,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:27,897 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:27,899 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:27,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,902 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:27,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:27,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:27,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:27,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:27,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:27,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:27,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:27,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:27,902 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:27,902 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:28,002 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:28,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:28,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:28,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:28,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,012 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:28,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:28,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:28,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:28,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,014 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:28,014 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:28,015 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,015 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:28,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:28,016 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:28,016 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:28,016 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:28,039 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283d9f039b42594f7b8dc17af56bb9b065 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283d9f039b42594f7b8dc17af56bb9b065 2023-03-22 17:54:28,045 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/5fbcae17716942a9ab715cbdf9e23697 2023-03-22 17:54:28,050 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/5fbcae17716942a9ab715cbdf9e23697 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697 2023-03-22 17:54:28,055 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697, entries=1, sequenceid=21, filesize=5.0 K 2023-03-22 17:54:28,056 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 40ms, sequenceid=21, compaction requested=true 2023-03-22 17:54:28,056 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:28,056 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:28,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:28,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:28,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,057 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:28,057 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:28,060 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:28,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:28,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:28,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:28,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff2347[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:28,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:28,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,064 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,064 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:28,064 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:28,064 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:28,065 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,065 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:28,067 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:28,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:28,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:28,070 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:28,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:28,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:28,071 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,071 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:28,073 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,073 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,073 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:28,073 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,075 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,078 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,078 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:28,078 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:28,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:28,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:28,078 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:28,078 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:28,078 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,079 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:28,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:28,179 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:28,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:28,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:28,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:28,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,187 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:28,187 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:28,187 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:28,187 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:28,188 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,188 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,190 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:28,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,197 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,197 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:28,197 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:28,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:28,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:28,204 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:28,204 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:28,205 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:28,639 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319afbf0cbec1a43a4b28dfb54d7982200 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512319afbf0cbec1a43a4b28dfb54d7982200 2023-03-22 17:54:29,048 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/9b29075d22b34561b2f2dd6258034d54 2023-03-22 17:54:29,053 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/9b29075d22b34561b2f2dd6258034d54 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54 2023-03-22 17:54:29,058 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54, entries=1, sequenceid=25, filesize=5.0 K 2023-03-22 17:54:29,059 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 854ms, sequenceid=25, compaction requested=true 2023-03-22 17:54:29,059 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:29,059 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,059 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:29,059 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:29,059 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,059 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:29,059 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:29,062 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:29,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:29,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aad419f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:29,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:29,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,065 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,065 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:29,066 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:29,066 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:29,066 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,066 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:29,067 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:29,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:29,073 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:29,073 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:29,073 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:29,073 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,073 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:29,075 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,075 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,075 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,076 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,078 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,083 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:29,084 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:29,084 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:29,184 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:29,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:29,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:29,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:29,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,191 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:29,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:29,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,193 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:29,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,195 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,195 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:29,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,195 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:29,195 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,195 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:29,195 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:29,195 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:29,196 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,196 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:29,196 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:29,242 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010135c95136bc964572870038e593e00cc8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010135c95136bc964572870038e593e00cc8 2023-03-22 17:54:29,264 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/419bc741565d4a4291c4f89f8a39074c 2023-03-22 17:54:29,270 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/419bc741565d4a4291c4f89f8a39074c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c 2023-03-22 17:54:29,275 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c, entries=1, sequenceid=29, filesize=5.0 K 2023-03-22 17:54:29,276 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 80ms, sequenceid=29, compaction requested=true 2023-03-22 17:54:29,277 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:29,277 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:29,279 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,279 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,279 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,279 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:29,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a5702fc[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:29,281 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:29,281 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,282 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:29,282 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,282 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:29,285 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,285 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:29,285 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,285 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:29,288 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:29,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:29,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:29,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,288 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:29,290 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,290 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,290 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,290 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,291 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,296 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,296 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:29,297 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:29,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,397 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:29,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:29,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,405 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,405 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,405 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:29,405 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:29,405 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,405 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,408 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,408 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,408 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,408 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:29,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:29,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:29,410 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,410 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:29,410 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:29,832 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103448a8bc792b14c06a8a232a337f66022 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103448a8bc792b14c06a8a232a337f66022 2023-03-22 17:54:29,839 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/4822ed38f67d449e9dca19f8dc4006aa 2023-03-22 17:54:29,857 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/4822ed38f67d449e9dca19f8dc4006aa as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa 2023-03-22 17:54:29,863 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa, entries=1, sequenceid=33, filesize=5.0 K 2023-03-22 17:54:29,864 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 454ms, sequenceid=33, compaction requested=true 2023-03-22 17:54:29,864 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:29,864 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:29,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:29,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:29,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:29,866 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,866 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:29,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a76160[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:29,868 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:29,868 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,870 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:29,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:29,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:29,870 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,870 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:29,871 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:29,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:29,875 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:29,875 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:29,875 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:29,875 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,875 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:29,877 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,877 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,877 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:29,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,878 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,880 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:29,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,883 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:29,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:29,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:29,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:29,983 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:29,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:29,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:29,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,991 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,991 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,993 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:29,993 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:29,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,993 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:29,993 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:29,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:29,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:29,995 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:29,995 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:29,995 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:30,422 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077dec2d7455ad42969a62cce985d30dca to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509077dec2d7455ad42969a62cce985d30dca 2023-03-22 17:54:30,828 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/227b0761e1d04968a1e718d8e1f42dd0 2023-03-22 17:54:30,833 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/227b0761e1d04968a1e718d8e1f42dd0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0 2023-03-22 17:54:30,838 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0, entries=1, sequenceid=37, filesize=5.0 K 2023-03-22 17:54:30,838 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 843ms, sequenceid=37, compaction requested=true 2023-03-22 17:54:30,838 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:30,839 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:30,840 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,840 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:30,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:30,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bba8548[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:30,842 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:30,842 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,844 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,844 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:30,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:30,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:30,845 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,845 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:30,846 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:30,846 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:30,846 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,846 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:30,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:30,849 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:30,849 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:30,849 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:30,849 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,849 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:30,851 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,851 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:30,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,851 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:30,852 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:30,857 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:30,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:30,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:30,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-22 17:54:30,857 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:30,858 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:30,958 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:30,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:30,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:30,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:30,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,966 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:30,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:30,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-22 17:54:30,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-22 17:54:30,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,971 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:30,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:30,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:30,972 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,973 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-22 17:54:30,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:30,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-22 17:54:30,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:30,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-22 17:54:30,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:30,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:30,973 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:30,973 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. started... 2023-03-22 17:54:30,973 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7eaae50c2de027d9af0c25b2dce0ffdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:30,986 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112027fc2c14f0744007b861665569b35d49 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112027fc2c14f0744007b861665569b35d49 2023-03-22 17:54:31,226 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:31,392 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/5759e42801f04ebb8481fb4e9f452968 2023-03-22 17:54:31,398 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/5759e42801f04ebb8481fb4e9f452968 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968 2023-03-22 17:54:31,403 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968, entries=1, sequenceid=41, filesize=5.0 K 2023-03-22 17:54:31,403 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7eaae50c2de027d9af0c25b2dce0ffdc in 430ms, sequenceid=41, compaction requested=true 2023-03-22 17:54:31,404 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:31,404 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-22 17:54:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-22 17:54:31,405 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:31,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-22 17:54:31,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bbb9819[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:31,408 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-22 17:54:31,408 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,409 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-22 17:54:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-22 17:54:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:31,410 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,410 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:31,411 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:31,411 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-22 17:54:31,411 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:31,411 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-22 17:54:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:31,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-22 17:54:31,413 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-22 17:54:31,413 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:31,413 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:31,414 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,414 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:31,416 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,416 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,416 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:31,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:31,417 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,420 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,420 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,420 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-22 17:54:31,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:31,421 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:31,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,421 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:31,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:31,422 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:31,422 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:31,523 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:31,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:31,525 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:31,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:31,527 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:31,528 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508271528 2023-03-22 17:54:31,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-22 17:54:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:31,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x654ff046 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:31,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c355bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:31,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:31,997 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103adab8b7886eb49e58becb5447a59ab44 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103adab8b7886eb49e58becb5447a59ab44 2023-03-22 17:54:31,998 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,016 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:32,017 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:32,024 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:32,026 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:32,041 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a98a2a46551643e8a30c5d93b2e1a2e4 first=Optional[r3] last=Optional[r6] 2023-03-22 17:54:32,041 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a98a2a46551643e8a30c5d93b2e1a2e4}] 2023-03-22 17:54:32,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a98a2a46551643e8a30c5d93b2e1a2e4 for inclusion in 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-22 17:54:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:32,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:32,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a98a2a46551643e8a30c5d93b2e1a2e4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2d6bch2552bfj1lnm5e1fgfetpoec8940t2orqg5767gev60ikeivu4h8dd6v2v4/family1/a98a2a46551643e8a30c5d93b2e1a2e4 2023-03-22 17:54:32,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2d6bch2552bfj1lnm5e1fgfetpoec8940t2orqg5767gev60ikeivu4h8dd6v2v4/family1/a98a2a46551643e8a30c5d93b2e1a2e4 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_ 2023-03-22 17:54:32,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2d6bch2552bfj1lnm5e1fgfetpoec8940t2orqg5767gev60ikeivu4h8dd6v2v4/family1/a98a2a46551643e8a30c5d93b2e1a2e4 into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_ - updating store file list. 2023-03-22 17:54:32,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_ into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2d6bch2552bfj1lnm5e1fgfetpoec8940t2orqg5767gev60ikeivu4h8dd6v2v4/family1/a98a2a46551643e8a30c5d93b2e1a2e4 into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_) 2023-03-22 17:54:32,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2d6bch2552bfj1lnm5e1fgfetpoec8940t2orqg5767gev60ikeivu4h8dd6v2v4/family1/a98a2a46551643e8a30c5d93b2e1a2e4 2023-03-22 17:54:32,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:54:32,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:54:32,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(1912): 7eaae50c2de027d9af0c25b2dce0ffdc/family1 is initiating minor compaction 2023-03-22 17:54:32,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@10bb3ada; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:32,072 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7eaae50c2de027d9af0c25b2dce0ffdc/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,072 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp, totalSize=50.4 K 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting ad205c9d02814d3a939a56b5cee76315, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting ce9f8c943fce49249f6283c7c05972a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting d27f0f4515724048a43bdb24939b78b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5fbcae17716942a9ab715cbdf9e23697, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 9b29075d22b34561b2f2dd6258034d54, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:54:32,072 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 419bc741565d4a4291c4f89f8a39074c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:54:32,073 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 4822ed38f67d449e9dca19f8dc4006aa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:54:32,073 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 227b0761e1d04968a1e718d8e1f42dd0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:54:32,073 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5759e42801f04ebb8481fb4e9f452968, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:54:32,073 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:54:32,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:32,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283d9f039b42594f7b8dc17af56bb9b065 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283d9f039b42594f7b8dc17af56bb9b065 2023-03-22 17:54:32,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512319afbf0cbec1a43a4b28dfb54d7982200 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512319afbf0cbec1a43a4b28dfb54d7982200 2023-03-22 17:54:32,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010135c95136bc964572870038e593e00cc8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010135c95136bc964572870038e593e00cc8 2023-03-22 17:54:32,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103448a8bc792b14c06a8a232a337f66022 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103448a8bc792b14c06a8a232a337f66022 2023-03-22 17:54:32,084 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-22 17:54:32,084 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-22 17:54:32,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,086 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,122 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7eaae50c2de027d9af0c25b2dce0ffdc#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:32,158 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d0192922df1a4754aea5a5246f5b7056 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d0192922df1a4754aea5a5246f5b7056 2023-03-22 17:54:32,159 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,193 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2ac0b8d1e25340df86475c5e91bb1603 first=Optional[r00] last=Optional[r2] 2023-03-22 17:54:32,193 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2ac0b8d1e25340df86475c5e91bb1603}] 2023-03-22 17:54:32,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2ac0b8d1e25340df86475c5e91bb1603 for inclusion in 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-22 17:54:32,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:32,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:32,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2ac0b8d1e25340df86475c5e91bb1603 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__krm0uf54lj3p3ggdtqgpihmu262ouph3e8slga63lis8cvoh22lgr049gtip7u3t/family1/2ac0b8d1e25340df86475c5e91bb1603 2023-03-22 17:54:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__krm0uf54lj3p3ggdtqgpihmu262ouph3e8slga63lis8cvoh22lgr049gtip7u3t/family1/2ac0b8d1e25340df86475c5e91bb1603 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ 2023-03-22 17:54:32,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__krm0uf54lj3p3ggdtqgpihmu262ouph3e8slga63lis8cvoh22lgr049gtip7u3t/family1/2ac0b8d1e25340df86475c5e91bb1603 into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ - updating store file list. 2023-03-22 17:54:32,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__krm0uf54lj3p3ggdtqgpihmu262ouph3e8slga63lis8cvoh22lgr049gtip7u3t/family1/2ac0b8d1e25340df86475c5e91bb1603 into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_) 2023-03-22 17:54:32,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__krm0uf54lj3p3ggdtqgpihmu262ouph3e8slga63lis8cvoh22lgr049gtip7u3t/family1/2ac0b8d1e25340df86475c5e91bb1603 2023-03-22 17:54:32,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,211 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:32,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300188ce2ca03a496d8ea24653d6508849 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300188ce2ca03a496d8ea24653d6508849 2023-03-22 17:54:32,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120186d422549cff41108b74b1c2308f1ed4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120186d422549cff41108b74b1c2308f1ed4 2023-03-22 17:54:32,216 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f057dc90ff4042f0ba518c429d812b4c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f057dc90ff4042f0ba518c429d812b4c 2023-03-22 17:54:32,216 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-22 17:54:32,216 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-22 17:54:32,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:32,221 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:32,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 695 msec 2023-03-22 17:54:32,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-22 17:54:32,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:32,355 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:32,357 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:32,357 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:32,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-22 17:54:32,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE}] 2023-03-22 17:54:32,365 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE 2023-03-22 17:54:32,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:32,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507672366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507672366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507672366"}]},"ts":"1679507672366"} 2023-03-22 17:54:32,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:32,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7eaae50c2de027d9af0c25b2dce0ffdc, disabling compactions & flushes 2023-03-22 17:54:32,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,553 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/c4a2e6dce5d94105a45f1a74ba888630 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630 2023-03-22 17:54:32,558 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7eaae50c2de027d9af0c25b2dce0ffdc/family1 of 7eaae50c2de027d9af0c25b2dce0ffdc into c4a2e6dce5d94105a45f1a74ba888630(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:32,558 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:32,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. after waiting 0 ms 2023-03-22 17:54:32,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,558 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679507672072; duration=0sec 2023-03-22 17:54:32,558 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:32,573 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_] to archive 2023-03-22 17:54:32,574 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:32,579 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ad205c9d02814d3a939a56b5cee76315 2023-03-22 17:54:32,581 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/ce9f8c943fce49249f6283c7c05972a1 2023-03-22 17:54:32,582 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d27f0f4515724048a43bdb24939b78b0 2023-03-22 17:54:32,584 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5fbcae17716942a9ab715cbdf9e23697 2023-03-22 17:54:32,585 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/9b29075d22b34561b2f2dd6258034d54 2023-03-22 17:54:32,591 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/419bc741565d4a4291c4f89f8a39074c 2023-03-22 17:54:32,592 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/4822ed38f67d449e9dca19f8dc4006aa 2023-03-22 17:54:32,594 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/227b0761e1d04968a1e718d8e1f42dd0 2023-03-22 17:54:32,595 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/5759e42801f04ebb8481fb4e9f452968 2023-03-22 17:54:32,596 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/bfd874f1c77d41d48f4608381e9aa2dd_SeqId_44_ 2023-03-22 17:54:32,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-22 17:54:32,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:32,610 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7eaae50c2de027d9af0c25b2dce0ffdc to self. 2023-03-22 17:54:32,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=CLOSED 2023-03-22 17:54:32,612 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507672612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507672612"}]},"ts":"1679507672612"} 2023-03-22 17:54:32,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-22 17:54:32,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 245 msec 2023-03-22 17:54:32,615 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=true 2023-03-22 17:54:32,766 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:32,766 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507672766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507672766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507672766"}]},"ts":"1679507672766"} 2023-03-22 17:54:32,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:32,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eaae50c2de027d9af0c25b2dce0ffdc, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:32,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:32,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,924 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,925 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,925 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:32,926 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eaae50c2de027d9af0c25b2dce0ffdc columnFamilyName family1 2023-03-22 17:54:32,932 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ 2023-03-22 17:54:32,936 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630 2023-03-22 17:54:32,939 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc 2023-03-22 17:54:32,939 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(310): Store=7eaae50c2de027d9af0c25b2dce0ffdc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:32,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7eaae50c2de027d9af0c25b2dce0ffdc; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73736353, jitterRate=0.09875728189945221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:32,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., pid=47, masterSystemTime=1679507672919 2023-03-22 17:54:32,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:32,947 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:54:32,948 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:54:32,948 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1912): 7eaae50c2de027d9af0c25b2dce0ffdc/family1 is initiating minor compaction (all files) 2023-03-22 17:54:32,948 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7eaae50c2de027d9af0c25b2dce0ffdc/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,948 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp, totalSize=390.1 K 2023-03-22 17:54:32,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:32,949 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting d6fb3b2453144174ac9875d9743411bc, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:54:32,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:32,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507672949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507672949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507672949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507672949"}]},"ts":"1679507672949"} 2023-03-22 17:54:32,949 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting c4a2e6dce5d94105a45f1a74ba888630, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:54:32,950 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 6a8d889ddf9944fe80d4db34c499d832_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878841570 2023-03-22 17:54:32,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-22 17:54:32,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 182 msec 2023-03-22 17:54:32,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-22 17:54:32,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE in 588 msec 2023-03-22 17:54:32,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-22 17:54:32,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 596 msec 2023-03-22 17:54:32,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 618 msec 2023-03-22 17:54:32,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-22 17:54:32,962 INFO [Listener at localhost/34365] compactions.TestMobCompactor(278): alter status finished 2023-03-22 17:54:32,962 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:32,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:32,965 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:32,968 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7eaae50c2de027d9af0c25b2dce0ffdc#family1#compaction#61 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:32,976 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508272976 2023-03-22 17:54:32,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:32,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:32,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-22 17:54:32,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:32,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x6fd798d9 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:32,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dab6615, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:32,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:32,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:33,811 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/.tmp/family1/39af0ab48c874cd4b724e6ae70130c46 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/39af0ab48c874cd4b724e6ae70130c46 2023-03-22 17:54:33,820 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7eaae50c2de027d9af0c25b2dce0ffdc/family1 of 7eaae50c2de027d9af0c25b2dce0ffdc into 39af0ab48c874cd4b724e6ae70130c46(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:33,820 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:33,820 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., storeName=7eaae50c2de027d9af0c25b2dce0ffdc/family1, priority=13, startTime=1679507672946; duration=0sec 2023-03-22 17:54:33,820 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:33,840 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e28e9e9fbfe842aaaf7660988a1b89c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128e28e9e9fbfe842aaaf7660988a1b89c2 2023-03-22 17:54:33,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:33,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_] to archive 2023-03-22 17:54:33,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:33,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/d6fb3b2453144174ac9875d9743411bc 2023-03-22 17:54:33,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/c4a2e6dce5d94105a45f1a74ba888630 2023-03-22 17:54:33,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/6a8d889ddf9944fe80d4db34c499d832_SeqId_46_ 2023-03-22 17:54:33,862 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:33,863 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:33,875 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:33,878 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:33,887 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7587c1eb83f444019738ccc12daeeead first=Optional[r05] last=Optional[r8] 2023-03-22 17:54:33,888 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=50 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7587c1eb83f444019738ccc12daeeead}] 2023-03-22 17:54:33,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7587c1eb83f444019738ccc12daeeead for inclusion in 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:33,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-22 17:54:33,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:33,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:33,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7587c1eb83f444019738ccc12daeeead to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pu77kugbc8r6pij282dpjjcoedoqguq8vtl9kfbq6hrk9rhqpno77hhqd7a7fpa2/family1/7587c1eb83f444019738ccc12daeeead 2023-03-22 17:54:33,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pu77kugbc8r6pij282dpjjcoedoqguq8vtl9kfbq6hrk9rhqpno77hhqd7a7fpa2/family1/7587c1eb83f444019738ccc12daeeead as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/748c516277be4cbe9f29c72fae46b5e6_SeqId_53_ 2023-03-22 17:54:33,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pu77kugbc8r6pij282dpjjcoedoqguq8vtl9kfbq6hrk9rhqpno77hhqd7a7fpa2/family1/7587c1eb83f444019738ccc12daeeead into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/748c516277be4cbe9f29c72fae46b5e6_SeqId_53_ - updating store file list. 2023-03-22 17:54:33,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/748c516277be4cbe9f29c72fae46b5e6_SeqId_53_ into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:33,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pu77kugbc8r6pij282dpjjcoedoqguq8vtl9kfbq6hrk9rhqpno77hhqd7a7fpa2/family1/7587c1eb83f444019738ccc12daeeead into 7eaae50c2de027d9af0c25b2dce0ffdc/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/748c516277be4cbe9f29c72fae46b5e6_SeqId_53_) 2023-03-22 17:54:33,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pu77kugbc8r6pij282dpjjcoedoqguq8vtl9kfbq6hrk9rhqpno77hhqd7a7fpa2/family1/7587c1eb83f444019738ccc12daeeead 2023-03-22 17:54:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:33,908 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:33,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112027fc2c14f0744007b861665569b35d49 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112027fc2c14f0744007b861665569b35d49 2023-03-22 17:54:33,911 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128302cecb9fd6f477eb15dcce2af53fe4d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128302cecb9fd6f477eb15dcce2af53fe4d 2023-03-22 17:54:33,911 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-22 17:54:33,911 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-22 17:54:33,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:33,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:33,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:33,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:33,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:33,913 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:33,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 950 msec 2023-03-22 17:54:33,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:54:33,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:34,021 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-22 17:54:34,022 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:34,022 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-22 17:54:34,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-22 17:54:34,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE}] 2023-03-22 17:54:34,037 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE 2023-03-22 17:54:34,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:34,038 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507674038"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507674038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507674038"}]},"ts":"1679507674038"} 2023-03-22 17:54:34,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:34,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7eaae50c2de027d9af0c25b2dce0ffdc, disabling compactions & flushes 2023-03-22 17:54:34,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. after waiting 0 ms 2023-03-22 17:54:34,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-22 17:54:34,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:34,201 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7eaae50c2de027d9af0c25b2dce0ffdc to self. 2023-03-22 17:54:34,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,204 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=CLOSED 2023-03-22 17:54:34,204 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507674204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507674204"}]},"ts":"1679507674204"} 2023-03-22 17:54:34,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-22 17:54:34,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 166 msec 2023-03-22 17:54:34,208 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=true 2023-03-22 17:54:34,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:34,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507674359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507674359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507674359"}]},"ts":"1679507674359"} 2023-03-22 17:54:34,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:34,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eaae50c2de027d9af0c25b2dce0ffdc, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:34,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:34,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,517 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,518 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:34,518 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1 2023-03-22 17:54:34,518 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eaae50c2de027d9af0c25b2dce0ffdc columnFamilyName family1 2023-03-22 17:54:34,523 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/39af0ab48c874cd4b724e6ae70130c46 2023-03-22 17:54:34,525 DEBUG [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/family1/748c516277be4cbe9f29c72fae46b5e6_SeqId_53_ 2023-03-22 17:54:34,526 INFO [StoreOpener-7eaae50c2de027d9af0c25b2dce0ffdc-1] regionserver.HStore(310): Store=7eaae50c2de027d9af0c25b2dce0ffdc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:34,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:54:34,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7eaae50c2de027d9af0c25b2dce0ffdc; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61751727, jitterRate=-0.07982756197452545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:34,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:54:34,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc., pid=53, masterSystemTime=1679507674512 2023-03-22 17:54:34,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:54:34,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7eaae50c2de027d9af0c25b2dce0ffdc, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:34,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679507674533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507674533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507674533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507674533"}]},"ts":"1679507674533"} 2023-03-22 17:54:34,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-22 17:54:34,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 7eaae50c2de027d9af0c25b2dce0ffdc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 173 msec 2023-03-22 17:54:34,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-22 17:54:34,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7eaae50c2de027d9af0c25b2dce0ffdc, REOPEN/MOVE in 499 msec 2023-03-22 17:54:34,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-22 17:54:34,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 512 msec 2023-03-22 17:54:34,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 554 msec 2023-03-22 17:54:34,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-22 17:54:34,541 INFO [Listener at localhost/34365] compactions.TestMobCompactor(278): alter status finished 2023-03-22 17:54:34,542 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-22 17:54:34,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:34,544 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:34,545 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508274545 2023-03-22 17:54:34,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:34,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:34,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-22 17:54:34,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:34,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x08d5e099 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:34,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ee8a458, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-22 17:54:34,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-22 17:54:34,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:34,553 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-22 17:54:34,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-03-22 17:54:34,600 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=263 (was 264), OpenFileDescriptor=645 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=400 (was 342) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6052 (was 6068) 2023-03-22 17:54:34,612 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=263, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=169, AvailableMemoryMB=6052 2023-03-22 17:54:34,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-22 17:54:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:34,616 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:34,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-22 17:54:34,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:34,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:34,618 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:34,619 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 empty. 2023-03-22 17:54:34,619 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:34,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-22 17:54:34,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:34,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:35,027 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:35,028 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => fde19d3a3b3c0cf9a44bc6d567be31f2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:35,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing fde19d3a3b3c0cf9a44bc6d567be31f2, disabling compactions & flushes 2023-03-22 17:54:35,434 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. after waiting 0 ms 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,434 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,434 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:35,436 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:35,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507675437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507675437"}]},"ts":"1679507675437"} 2023-03-22 17:54:35,439 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:54:35,439 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:35,439 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507675439"}]},"ts":"1679507675439"} 2023-03-22 17:54:35,440 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-22 17:54:35,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, ASSIGN}] 2023-03-22 17:54:35,444 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, ASSIGN 2023-03-22 17:54:35,445 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:35,596 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:35,596 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507675596"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507675596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507675596"}]},"ts":"1679507675596"} 2023-03-22 17:54:35,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:35,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:35,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fde19d3a3b3c0cf9a44bc6d567be31f2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,753 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,754 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:35,755 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:35,755 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde19d3a3b3c0cf9a44bc6d567be31f2 columnFamilyName family1 2023-03-22 17:54:35,756 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(310): Store=fde19d3a3b3c0cf9a44bc6d567be31f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:35,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:35,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:35,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fde19d3a3b3c0cf9a44bc6d567be31f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69230765, jitterRate=0.031618788838386536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:35,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:35,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., pid=57, masterSystemTime=1679507675749 2023-03-22 17:54:35,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:35,765 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:35,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507675764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507675764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507675764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507675764"}]},"ts":"1679507675764"} 2023-03-22 17:54:35,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-22 17:54:35,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635 in 168 msec 2023-03-22 17:54:35,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-22 17:54:35,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, ASSIGN in 324 msec 2023-03-22 17:54:35,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:35,769 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507675769"}]},"ts":"1679507675769"} 2023-03-22 17:54:35,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-22 17:54:35,773 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:35,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-03-22 17:54:36,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-22 17:54:36,723 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-22 17:54:36,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:36,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,746 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:36,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:36,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:36,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:36,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,750 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:36,750 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:36,750 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:36,750 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:36,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:36,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:36,754 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:36,755 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:36,755 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:36,755 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:54:37,176 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113031926b0e41384dceb99b539f3cf81573 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031926b0e41384dceb99b539f3cf81573 2023-03-22 17:54:37,580 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/272a1763e3224bc38aeeb5a95b35c344 2023-03-22 17:54:37,584 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/272a1763e3224bc38aeeb5a95b35c344 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344 2023-03-22 17:54:37,588 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-22 17:54:37,588 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 833ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:37,589 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:37,589 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:37,589 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:37,589 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:37,589 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:37,589 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,589 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:37,589 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:37,591 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,591 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:37,591 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,591 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:37,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:37,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49b92b70[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:37,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:37,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,593 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,593 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:37,594 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:37,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:37,594 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:37,595 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:37,595 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:37,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,595 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:37,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:37,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:37,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:37,597 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:37,597 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:37,597 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:37,597 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,597 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:37,599 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:37,600 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:37,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:37,600 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,601 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:37,603 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:37,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:37,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:37,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:37,603 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,604 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:37,604 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,604 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:37,704 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:37,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:37,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:37,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:37,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,710 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:37,710 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:37,710 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:37,710 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:37,711 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,711 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,715 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:37,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:37,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:37,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:37,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:37,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:37,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,716 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:37,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:37,716 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:37,716 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:37,717 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:37,717 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:54:38,110 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:38,129 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280f3f6779b0e84b308d235ed5d55da9b8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280f3f6779b0e84b308d235ed5d55da9b8 2023-03-22 17:54:38,135 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/a2afdf4d6dfb4236befc3eaec44b0db2 2023-03-22 17:54:38,139 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/a2afdf4d6dfb4236befc3eaec44b0db2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2 2023-03-22 17:54:38,143 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:54:38,144 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 427ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:38,144 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:38,145 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:38,145 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:38,145 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:38,145 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,145 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:38,145 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,148 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,148 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:38,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:38,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21fdff46[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:38,149 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:38,149 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,151 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,151 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:38,151 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:38,151 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:38,151 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,151 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:38,152 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:38,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:38,154 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:38,154 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:38,154 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:38,154 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,154 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:38,156 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,156 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:38,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,156 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:38,156 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,157 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:38,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:38,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:38,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:38,161 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:38,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:38,161 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:38,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:38,262 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:38,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:38,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,268 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:38,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:38,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:38,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:38,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,268 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,269 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:38,269 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:38,270 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:38,270 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,270 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:38,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:38,271 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:38,271 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:38,271 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:38,684 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c1c1786e1bff4817a1bcd6c937b80ed8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c1c1786e1bff4817a1bcd6c937b80ed8 2023-03-22 17:54:39,089 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/05e44309bee54eeaa24457d6c79e9d70 2023-03-22 17:54:39,093 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/05e44309bee54eeaa24457d6c79e9d70 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70 2023-03-22 17:54:39,097 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70, entries=1, sequenceid=13, filesize=5.0 K 2023-03-22 17:54:39,098 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 827ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:39,098 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:39,098 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:39,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:39,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:39,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:39,098 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:39,100 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:39,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e92aef4[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:39,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:39,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,103 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:39,103 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,103 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:39,105 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:39,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:39,107 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:39,107 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:39,107 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:39,107 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,107 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:39,108 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,108 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:39,109 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,110 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,112 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:39,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:39,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:39,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:39,112 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:39,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:39,213 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:39,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:39,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:39,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:39,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,220 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:39,220 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:39,220 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:39,220 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:39,220 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,220 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,223 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:39,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:39,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:39,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:39,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:39,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:39,224 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:39,224 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:39,225 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:39,225 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:39,225 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:39,342 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-22 17:54:39,637 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a2df02e9995945cb9d3e274516981e5a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2df02e9995945cb9d3e274516981e5a 2023-03-22 17:54:40,043 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/b15f402685b84d969997405a3067b06a 2023-03-22 17:54:40,047 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/b15f402685b84d969997405a3067b06a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a 2023-03-22 17:54:40,051 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a, entries=1, sequenceid=17, filesize=5.0 K 2023-03-22 17:54:40,051 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 826ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:40,052 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:40,052 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:40,052 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:40,053 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,053 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:40,054 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,054 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:40,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:40,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9be9e6f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:40,055 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:40,055 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,056 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:40,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:40,056 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:40,056 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,057 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:40,062 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:40,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:40,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:40,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:40,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:40,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:40,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:40,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:40,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:40,064 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:40,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:40,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:40,064 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,064 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:40,066 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,066 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:40,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,066 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:40,066 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,067 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:40,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:40,069 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:40,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:40,069 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:40,070 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,070 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:40,070 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:40,070 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:40,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:40,070 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,170 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:40,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:40,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:40,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:40,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,176 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:40,176 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:40,176 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:40,176 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:40,177 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,177 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,179 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,179 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:40,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:40,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:40,180 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:40,180 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,180 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:40,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:40,181 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:40,181 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:40,181 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:40,181 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:40,181 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:40,181 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:40,181 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:40,181 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:40,593 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e2b1bdfc0fca45968c41936bb8a9665b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2b1bdfc0fca45968c41936bb8a9665b 2023-03-22 17:54:40,999 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/3530051a9f6b4775bc7566ad2bfd397b 2023-03-22 17:54:41,004 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/3530051a9f6b4775bc7566ad2bfd397b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b 2023-03-22 17:54:41,007 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b, entries=1, sequenceid=21, filesize=5.0 K 2023-03-22 17:54:41,008 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 827ms, sequenceid=21, compaction requested=true 2023-03-22 17:54:41,008 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:41,008 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:41,008 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:41,008 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:41,009 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,009 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:41,009 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:41,010 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:41,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@95cc683[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:41,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:41,012 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,013 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,013 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:41,013 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:41,013 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,013 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:41,013 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:41,014 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,014 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:41,015 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,015 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:41,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:41,016 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:41,017 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:41,017 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:41,017 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,017 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:41,019 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,019 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,019 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:41,019 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,020 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:41,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:41,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:41,022 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:41,022 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:41,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,023 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:41,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:41,023 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:41,123 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:41,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:41,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:41,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:41,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,129 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:41,129 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:41,129 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:41,129 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:41,130 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,130 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,131 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:41,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:41,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,131 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,132 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:41,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:41,132 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:41,132 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:41,133 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:41,545 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231452f5525675f42d69ba85dad975f2116 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231452f5525675f42d69ba85dad975f2116 2023-03-22 17:54:41,950 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/a2f4014f4cd54640a6b2de557a3a8c03 2023-03-22 17:54:41,954 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/a2f4014f4cd54640a6b2de557a3a8c03 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03 2023-03-22 17:54:41,958 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03, entries=1, sequenceid=25, filesize=5.0 K 2023-03-22 17:54:41,958 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 825ms, sequenceid=25, compaction requested=true 2023-03-22 17:54:41,959 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:41,959 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:41,959 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:41,959 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:41,959 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,959 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:41,959 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:41,960 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,961 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,961 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,961 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:41,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47951f21[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:41,962 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:41,962 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,964 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:41,964 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,964 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:41,966 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:41,966 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,966 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,966 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:41,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:41,968 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:41,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:41,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:41,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,968 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:41,969 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,969 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,969 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:41,970 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:41,971 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,976 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:41,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:41,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:41,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:41,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:41,976 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:41,977 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,977 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:41,977 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,977 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:41,977 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:42,077 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:42,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:42,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:42,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,084 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:42,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:42,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:42,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:42,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,088 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:42,088 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:42,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,089 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,089 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:42,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:42,090 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:42,090 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:42,090 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:42,503 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010fa7b45061f74aa0aa6912eac9407d9a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010fa7b45061f74aa0aa6912eac9407d9a 2023-03-22 17:54:42,909 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf 2023-03-22 17:54:42,913 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf 2023-03-22 17:54:42,916 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf, entries=1, sequenceid=29, filesize=5.0 K 2023-03-22 17:54:42,917 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 827ms, sequenceid=29, compaction requested=true 2023-03-22 17:54:42,917 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:42,917 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:42,917 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:42,919 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:42,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:42,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3bfc29[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:42,921 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:42,921 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,922 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:42,922 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:42,922 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,922 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:42,924 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:42,924 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:42,924 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,924 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:42,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:42,926 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:42,926 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:42,926 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:42,926 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,926 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:42,928 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:42,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:42,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:42,928 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,929 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:42,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:42,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,931 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:42,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:42,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:42,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:42,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:42,931 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:42,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:42,932 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,032 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:43,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:43,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:43,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:43,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,038 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:43,038 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:43,038 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:43,038 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:43,039 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,039 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,040 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,040 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:43,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:43,040 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,040 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,041 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,041 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:43,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:43,042 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:43,042 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:43,042 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:43,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ab1d8c59deda48629f40477501b9637e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab1d8c59deda48629f40477501b9637e 2023-03-22 17:54:43,859 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/f799cfb01baa4a4a9c5395ad54cbaeb2 2023-03-22 17:54:43,863 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/f799cfb01baa4a4a9c5395ad54cbaeb2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2 2023-03-22 17:54:43,867 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2, entries=1, sequenceid=33, filesize=5.0 K 2023-03-22 17:54:43,868 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 826ms, sequenceid=33, compaction requested=true 2023-03-22 17:54:43,868 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:43,868 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:43,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:43,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:43,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:43,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:43,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,870 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:43,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:43,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:43,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@710b5627[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:43,871 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:43,871 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,872 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,872 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:43,873 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:43,873 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,873 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:43,873 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:43,874 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,874 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:43,874 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:43,874 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:43,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:43,876 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:43,876 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:43,876 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:43,876 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,876 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:43,895 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:43,895 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x654ff046 to 127.0.0.1:60739 2023-03-22 17:54:43,895 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:43,895 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:43,895 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fd798d9 to 127.0.0.1:60739 2023-03-22 17:54:43,896 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:43,896 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d5e099 to 127.0.0.1:60739 2023-03-22 17:54:43,896 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:43,896 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:43,896 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x512733a0 to 127.0.0.1:60739 2023-03-22 17:54:43,896 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:43,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:43,897 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,899 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:43,900 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:43,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:43,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:43,902 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:43,902 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:43,903 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:43,903 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,003 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:44,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:44,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:44,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:44,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,009 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:44,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:44,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:44,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:44,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,016 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,016 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:44,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:44,016 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,016 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:44,017 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:44,018 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:44,018 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:44,430 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074f3393fbd9a64b23987b12249e5f978a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509074f3393fbd9a64b23987b12249e5f978a 2023-03-22 17:54:44,835 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/1ef863f2e877496cbeafccae33d98dad 2023-03-22 17:54:44,840 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/1ef863f2e877496cbeafccae33d98dad as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad 2023-03-22 17:54:44,844 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad, entries=1, sequenceid=37, filesize=5.0 K 2023-03-22 17:54:44,844 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 826ms, sequenceid=37, compaction requested=true 2023-03-22 17:54:44,844 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:44,845 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:44,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:44,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:44,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:44,845 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:44,846 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,846 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:44,847 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,847 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:44,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:44,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0cee5b[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:44,848 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:44,848 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,850 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,850 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:44,850 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:44,850 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:44,850 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,850 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:44,851 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,851 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:44,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:44,853 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:44,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:44,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:44,853 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,853 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:44,856 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,856 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:44,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,856 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:44,856 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:44,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:44,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:44,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,857 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:44,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:44,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:44,859 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:44,859 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:44,860 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:44,860 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:44,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:44,860 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,960 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:44,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,966 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:44,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:44,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-22 17:54:44,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-22 17:54:44,966 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,967 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,968 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:44,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:44,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:44,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:44,968 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:44,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:44,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,969 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-22 17:54:44,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:44,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-22 17:54:44,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:44,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-22 17:54:44,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:54:44,969 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:44,969 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:44,969 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. started... 2023-03-22 17:54:44,969 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fde19d3a3b3c0cf9a44bc6d567be31f2 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:54:45,381 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120090951d79c594e81b56901e67658249a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120090951d79c594e81b56901e67658249a 2023-03-22 17:54:45,786 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/aa146bd3dc144087abfa0bfe61ebdc5a 2023-03-22 17:54:45,790 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/aa146bd3dc144087abfa0bfe61ebdc5a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a 2023-03-22 17:54:45,794 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a, entries=1, sequenceid=41, filesize=5.0 K 2023-03-22 17:54:45,795 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fde19d3a3b3c0cf9a44bc6d567be31f2 in 826ms, sequenceid=41, compaction requested=true 2023-03-22 17:54:45,795 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:45,795 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:45,795 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:54:45,795 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:54:45,795 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,795 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-22 17:54:45,795 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-22 17:54:45,796 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,796 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:45,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,797 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:45,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:45,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:45,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:45,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-22 17:54:45,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718f96ac[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:45,798 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-22 17:54:45,798 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,799 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-22 17:54:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-22 17:54:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:45,800 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,800 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:45,801 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-22 17:54:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-22 17:54:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:45,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-22 17:54:45,803 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-22 17:54:45,803 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:45,803 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:45,803 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,803 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:45,805 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,805 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:45,805 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:45,806 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,807 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:45,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:45,809 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:45,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-22 17:54:45,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:45,809 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,909 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:45,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:45,911 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:45,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:45,913 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:45,914 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508285914 2023-03-22 17:54:45,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:45,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-22 17:54:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:45,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x7c1c5d93 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:45,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1332ea43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:45,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,757 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103365f8c50b83d432bb9a7f63fe0131e37 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103365f8c50b83d432bb9a7f63fe0131e37 2023-03-22 17:54:46,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:46,772 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:46,773 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:46,782 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:46,783 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:46,796 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8156672793f942b7bcef72ccb434a1af first=Optional[r3] last=Optional[r6] 2023-03-22 17:54:46,797 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8156672793f942b7bcef72ccb434a1af}] 2023-03-22 17:54:46,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8156672793f942b7bcef72ccb434a1af for inclusion in fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:46,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-22 17:54:46,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:46,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:46,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8156672793f942b7bcef72ccb434a1af to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cgte2n4k2rkm72mscp4jcqj4eoo9sc9jbnu1n2r20c8gqjvgp879hsjkq1kvjdhg/family1/8156672793f942b7bcef72ccb434a1af 2023-03-22 17:54:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cgte2n4k2rkm72mscp4jcqj4eoo9sc9jbnu1n2r20c8gqjvgp879hsjkq1kvjdhg/family1/8156672793f942b7bcef72ccb434a1af as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_ 2023-03-22 17:54:46,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cgte2n4k2rkm72mscp4jcqj4eoo9sc9jbnu1n2r20c8gqjvgp879hsjkq1kvjdhg/family1/8156672793f942b7bcef72ccb434a1af into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_ - updating store file list. 2023-03-22 17:54:46,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_ into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:46,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cgte2n4k2rkm72mscp4jcqj4eoo9sc9jbnu1n2r20c8gqjvgp879hsjkq1kvjdhg/family1/8156672793f942b7bcef72ccb434a1af into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_) 2023-03-22 17:54:46,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cgte2n4k2rkm72mscp4jcqj4eoo9sc9jbnu1n2r20c8gqjvgp879hsjkq1kvjdhg/family1/8156672793f942b7bcef72ccb434a1af 2023-03-22 17:54:46,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:54:46,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:54:46,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): fde19d3a3b3c0cf9a44bc6d567be31f2/family1 is initiating minor compaction 2023-03-22 17:54:46,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6217088b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:46,817 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fde19d3a3b3c0cf9a44bc6d567be31f2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:46,817 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp, totalSize=50.3 K 2023-03-22 17:54:46,817 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting a2afdf4d6dfb4236befc3eaec44b0db2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 05e44309bee54eeaa24457d6c79e9d70, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting b15f402685b84d969997405a3067b06a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 3530051a9f6b4775bc7566ad2bfd397b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting a2f4014f4cd54640a6b2de557a3a8c03, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting bc3e63f3b5bf4fbe8ebab1e71340c5bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting f799cfb01baa4a4a9c5395ad54cbaeb2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1ef863f2e877496cbeafccae33d98dad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting aa146bd3dc144087abfa0bfe61ebdc5a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:54:46,818 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:54:46,819 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:46,821 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:46,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2b1bdfc0fca45968c41936bb8a9665b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e2b1bdfc0fca45968c41936bb8a9665b 2023-03-22 17:54:46,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231452f5525675f42d69ba85dad975f2116 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231452f5525675f42d69ba85dad975f2116 2023-03-22 17:54:46,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010fa7b45061f74aa0aa6912eac9407d9a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010fa7b45061f74aa0aa6912eac9407d9a 2023-03-22 17:54:46,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab1d8c59deda48629f40477501b9637e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ab1d8c59deda48629f40477501b9637e 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-22 17:54:46,827 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:46,846 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): fde19d3a3b3c0cf9a44bc6d567be31f2#family1#compaction#72 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:47,271 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a56da0f1114a44e788e7e3f8982e9061 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a56da0f1114a44e788e7e3f8982e9061 2023-03-22 17:54:47,272 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:47,296 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f1ce6c7562c64368b1ed497152280e5c first=Optional[r00] last=Optional[r2] 2023-03-22 17:54:47,296 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f1ce6c7562c64368b1ed497152280e5c}] 2023-03-22 17:54:47,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f1ce6c7562c64368b1ed497152280e5c for inclusion in fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:47,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-22 17:54:47,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:47,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:47,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f1ce6c7562c64368b1ed497152280e5c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__k99c0lkohqeck50ev5u1p6jbmvj0a8d8ghf737aqpv9ha0ugtdonr1jrlgmlrdrk/family1/f1ce6c7562c64368b1ed497152280e5c 2023-03-22 17:54:47,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__k99c0lkohqeck50ev5u1p6jbmvj0a8d8ghf737aqpv9ha0ugtdonr1jrlgmlrdrk/family1/f1ce6c7562c64368b1ed497152280e5c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ 2023-03-22 17:54:47,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__k99c0lkohqeck50ev5u1p6jbmvj0a8d8ghf737aqpv9ha0ugtdonr1jrlgmlrdrk/family1/f1ce6c7562c64368b1ed497152280e5c into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ - updating store file list. 2023-03-22 17:54:47,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:47,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__k99c0lkohqeck50ev5u1p6jbmvj0a8d8ghf737aqpv9ha0ugtdonr1jrlgmlrdrk/family1/f1ce6c7562c64368b1ed497152280e5c into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_) 2023-03-22 17:54:47,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__k99c0lkohqeck50ev5u1p6jbmvj0a8d8ghf737aqpv9ha0ugtdonr1jrlgmlrdrk/family1/f1ce6c7562c64368b1ed497152280e5c 2023-03-22 17:54:47,310 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:47,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:47,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031926b0e41384dceb99b539f3cf81573 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031926b0e41384dceb99b539f3cf81573 2023-03-22 17:54:47,313 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c1c1786e1bff4817a1bcd6c937b80ed8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c1c1786e1bff4817a1bcd6c937b80ed8 2023-03-22 17:54:47,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2df02e9995945cb9d3e274516981e5a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2df02e9995945cb9d3e274516981e5a 2023-03-22 17:54:47,314 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-22 17:54:47,314 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-22 17:54:47,314 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:47,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:47,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:47,316 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:47,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4040 sec 2023-03-22 17:54:47,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-22 17:54:47,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:47,665 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/5adc12d355af4a7591f41de0d54d609a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a 2023-03-22 17:54:47,669 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fde19d3a3b3c0cf9a44bc6d567be31f2/family1 of fde19d3a3b3c0cf9a44bc6d567be31f2 into 5adc12d355af4a7591f41de0d54d609a(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:47,669 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:47,669 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679507686817; duration=0sec 2023-03-22 17:54:47,669 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:47,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_] to archive 2023-03-22 17:54:47,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:47,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2afdf4d6dfb4236befc3eaec44b0db2 2023-03-22 17:54:47,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/05e44309bee54eeaa24457d6c79e9d70 2023-03-22 17:54:47,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/b15f402685b84d969997405a3067b06a 2023-03-22 17:54:47,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3530051a9f6b4775bc7566ad2bfd397b 2023-03-22 17:54:47,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/a2f4014f4cd54640a6b2de557a3a8c03 2023-03-22 17:54:47,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/bc3e63f3b5bf4fbe8ebab1e71340c5bf 2023-03-22 17:54:47,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/f799cfb01baa4a4a9c5395ad54cbaeb2 2023-03-22 17:54:47,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/1ef863f2e877496cbeafccae33d98dad 2023-03-22 17:54:47,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/aa146bd3dc144087abfa0bfe61ebdc5a 2023-03-22 17:54:47,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/8394a38dfa0f492aa6bdbb56ba89c3ab_SeqId_44_ 2023-03-22 17:54:47,796 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:47,798 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:47,798 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:47,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-22 17:54:47,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE}] 2023-03-22 17:54:47,804 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE 2023-03-22 17:54:47,805 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:47,805 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507687805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507687805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507687805"}]},"ts":"1679507687805"} 2023-03-22 17:54:47,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:47,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:47,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fde19d3a3b3c0cf9a44bc6d567be31f2, disabling compactions & flushes 2023-03-22 17:54:47,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:47,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:47,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. after waiting 0 ms 2023-03-22 17:54:47,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:47,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-22 17:54:47,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:47,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:47,978 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: fde19d3a3b3c0cf9a44bc6d567be31f2 to self. 2023-03-22 17:54:47,981 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=CLOSED 2023-03-22 17:54:47,981 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507687981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507687981"}]},"ts":"1679507687981"} 2023-03-22 17:54:47,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:47,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-22 17:54:47,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635 in 170 msec 2023-03-22 17:54:47,985 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=true 2023-03-22 17:54:48,135 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:48,135 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507688135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507688135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507688135"}]},"ts":"1679507688135"} 2023-03-22 17:54:48,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:48,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fde19d3a3b3c0cf9a44bc6d567be31f2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:48,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:48,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,294 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,295 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:48,295 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:48,295 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde19d3a3b3c0cf9a44bc6d567be31f2 columnFamilyName family1 2023-03-22 17:54:48,303 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344 2023-03-22 17:54:48,329 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a 2023-03-22 17:54:48,335 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ 2023-03-22 17:54:48,336 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(310): Store=fde19d3a3b3c0cf9a44bc6d567be31f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:48,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fde19d3a3b3c0cf9a44bc6d567be31f2; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70495049, jitterRate=0.050458088517189026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:48,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:48,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., pid=63, masterSystemTime=1679507688289 2023-03-22 17:54:48,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-22 17:54:48,346 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:54:48,348 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:54:48,348 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1912): fde19d3a3b3c0cf9a44bc6d567be31f2/family1 is initiating minor compaction (all files) 2023-03-22 17:54:48,348 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fde19d3a3b3c0cf9a44bc6d567be31f2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,348 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp, totalSize=388.1 K 2023-03-22 17:54:48,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:48,349 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 272a1763e3224bc38aeeb5a95b35c344, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:54:48,349 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507688348"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507688348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507688348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507688348"}]},"ts":"1679507688348"} 2023-03-22 17:54:48,349 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5adc12d355af4a7591f41de0d54d609a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:54:48,350 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878841570 2023-03-22 17:54:48,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-22 17:54:48,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635 in 213 msec 2023-03-22 17:54:48,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-22 17:54:48,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE in 549 msec 2023-03-22 17:54:48,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-22 17:54:48,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 558 msec 2023-03-22 17:54:48,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 975 msec 2023-03-22 17:54:48,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-22 17:54:48,367 INFO [Listener at localhost/34365] compactions.TestMobCompactor(278): alter status finished 2023-03-22 17:54:48,369 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:48,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:48,373 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:48,374 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508288374 2023-03-22 17:54:48,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:48,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:48,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-22 17:54:48,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:48,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x6b63b065 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:48,386 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): fde19d3a3b3c0cf9a44bc6d567be31f2#family1#compaction#73 average throughput is 11.98 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:48,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4af41d4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:48,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,485 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/.tmp/family1/3d177426beaf4e8fab63bb468074f930 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3d177426beaf4e8fab63bb468074f930 2023-03-22 17:54:48,491 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fde19d3a3b3c0cf9a44bc6d567be31f2/family1 of fde19d3a3b3c0cf9a44bc6d567be31f2 into 3d177426beaf4e8fab63bb468074f930(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:48,491 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:48,491 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., storeName=fde19d3a3b3c0cf9a44bc6d567be31f2/family1, priority=13, startTime=1679507688345; duration=0sec 2023-03-22 17:54:48,491 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:48,536 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f1e81fac63e740c190345d8f9e409e8f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f1e81fac63e740c190345d8f9e409e8f 2023-03-22 17:54:48,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:48,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_] to archive 2023-03-22 17:54:48,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:48,568 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:48,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/272a1763e3224bc38aeeb5a95b35c344 2023-03-22 17:54:48,570 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35914, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:48,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/5adc12d355af4a7591f41de0d54d609a 2023-03-22 17:54:48,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/89a5a43c402442e38dcc6f63d57a88f3_SeqId_46_ 2023-03-22 17:54:48,589 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:48,591 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:48,612 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7b72138601f0495e999ba1a8f312e14b first=Optional[r05] last=Optional[r8] 2023-03-22 17:54:48,612 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=50 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7b72138601f0495e999ba1a8f312e14b}] 2023-03-22 17:54:48,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7b72138601f0495e999ba1a8f312e14b for inclusion in fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:48,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-22 17:54:48,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:48,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:48,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7b72138601f0495e999ba1a8f312e14b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pggjkterf07d0shvfbj73knnkkd8sdfofrdu0hl1f46jd5coodkep5namck7ie1i/family1/7b72138601f0495e999ba1a8f312e14b 2023-03-22 17:54:48,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pggjkterf07d0shvfbj73knnkkd8sdfofrdu0hl1f46jd5coodkep5namck7ie1i/family1/7b72138601f0495e999ba1a8f312e14b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/6efedd452d9846879ffa456fe358a6ea_SeqId_53_ 2023-03-22 17:54:48,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pggjkterf07d0shvfbj73knnkkd8sdfofrdu0hl1f46jd5coodkep5namck7ie1i/family1/7b72138601f0495e999ba1a8f312e14b into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/6efedd452d9846879ffa456fe358a6ea_SeqId_53_ - updating store file list. 2023-03-22 17:54:48,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/6efedd452d9846879ffa456fe358a6ea_SeqId_53_ into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:48,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pggjkterf07d0shvfbj73knnkkd8sdfofrdu0hl1f46jd5coodkep5namck7ie1i/family1/7b72138601f0495e999ba1a8f312e14b into fde19d3a3b3c0cf9a44bc6d567be31f2/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/6efedd452d9846879ffa456fe358a6ea_SeqId_53_) 2023-03-22 17:54:48,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pggjkterf07d0shvfbj73knnkkd8sdfofrdu0hl1f46jd5coodkep5namck7ie1i/family1/7b72138601f0495e999ba1a8f312e14b 2023-03-22 17:54:48,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:48,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:48,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120090951d79c594e81b56901e67658249a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120090951d79c594e81b56901e67658249a 2023-03-22 17:54:48,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280f3f6779b0e84b308d235ed5d55da9b8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280f3f6779b0e84b308d235ed5d55da9b8 2023-03-22 17:54:48,641 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-22 17:54:48,641 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-22 17:54:48,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:48,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:48,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:48,643 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:48,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 275 msec 2023-03-22 17:54:48,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-22 17:54:48,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:48,706 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-22 17:54:48,707 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-22 17:54:48,707 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-22 17:54:48,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-22 17:54:48,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE}] 2023-03-22 17:54:48,712 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE 2023-03-22 17:54:48,713 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:48,713 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507688713"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507688713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507688713"}]},"ts":"1679507688713"} 2023-03-22 17:54:48,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:48,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fde19d3a3b3c0cf9a44bc6d567be31f2, disabling compactions & flushes 2023-03-22 17:54:48,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. after waiting 0 ms 2023-03-22 17:54:48,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-22 17:54:48,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:48,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:48,871 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: fde19d3a3b3c0cf9a44bc6d567be31f2 to self. 2023-03-22 17:54:48,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:48,873 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=CLOSED 2023-03-22 17:54:48,873 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507688873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507688873"}]},"ts":"1679507688873"} 2023-03-22 17:54:48,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-22 17:54:48,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635 in 160 msec 2023-03-22 17:54:48,876 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=true 2023-03-22 17:54:49,027 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:49,027 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507689027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507689027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507689027"}]},"ts":"1679507689027"} 2023-03-22 17:54:49,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:49,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fde19d3a3b3c0cf9a44bc6d567be31f2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,186 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,188 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:49,188 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1 2023-03-22 17:54:49,189 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde19d3a3b3c0cf9a44bc6d567be31f2 columnFamilyName family1 2023-03-22 17:54:49,200 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/3d177426beaf4e8fab63bb468074f930 2023-03-22 17:54:49,205 DEBUG [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/family1/6efedd452d9846879ffa456fe358a6ea_SeqId_53_ 2023-03-22 17:54:49,205 INFO [StoreOpener-fde19d3a3b3c0cf9a44bc6d567be31f2-1] regionserver.HStore(310): Store=fde19d3a3b3c0cf9a44bc6d567be31f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:49,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:54:49,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fde19d3a3b3c0cf9a44bc6d567be31f2; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74667034, jitterRate=0.11262550950050354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:49,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:54:49,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2., pid=69, masterSystemTime=1679507689180 2023-03-22 17:54:49,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:49,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:54:49,217 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fde19d3a3b3c0cf9a44bc6d567be31f2, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:49,217 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679507689217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507689217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507689217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507689217"}]},"ts":"1679507689217"} 2023-03-22 17:54:49,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-22 17:54:49,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure fde19d3a3b3c0cf9a44bc6d567be31f2, server=jenkins-hbase4.apache.org,46619,1679507617635 in 189 msec 2023-03-22 17:54:49,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-22 17:54:49,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fde19d3a3b3c0cf9a44bc6d567be31f2, REOPEN/MOVE in 509 msec 2023-03-22 17:54:49,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-22 17:54:49,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 513 msec 2023-03-22 17:54:49,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 529 msec 2023-03-22 17:54:49,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-22 17:54:49,228 INFO [Listener at localhost/34365] compactions.TestMobCompactor(278): alter status finished 2023-03-22 17:54:49,229 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-22 17:54:49,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:49,231 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:49,233 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508289233 2023-03-22 17:54:49,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:49,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:54:49,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-22 17:54:49,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:49,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x2c0f0d86 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:49,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb5de9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:49,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-22 17:54:49,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-22 17:54:49,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:49,244 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-22 17:54:49,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 14 msec 2023-03-22 17:54:49,290 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=245 (was 263), OpenFileDescriptor=613 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=319 (was 400), ProcessCount=169 (was 169), AvailableMemoryMB=6022 (was 6052) 2023-03-22 17:54:49,302 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=169, AvailableMemoryMB=6022 2023-03-22 17:54:49,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-22 17:54:49,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:49,307 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:49,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-22 17:54:49,308 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-22 17:54:49,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed empty. 2023-03-22 17:54:49,311 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,311 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-22 17:54:49,322 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:49,324 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e4e986f562ee9fabc50018cd86c71ed, NAME => 'testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:49,334 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:49,334 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 1e4e986f562ee9fabc50018cd86c71ed, disabling compactions & flushes 2023-03-22 17:54:49,334 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,334 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,334 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. after waiting 0 ms 2023-03-22 17:54:49,334 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,334 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,335 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:49,337 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:49,338 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679507689338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507689338"}]},"ts":"1679507689338"} 2023-03-22 17:54:49,339 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:54:49,340 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:49,341 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507689340"}]},"ts":"1679507689340"} 2023-03-22 17:54:49,342 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-22 17:54:49,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, ASSIGN}] 2023-03-22 17:54:49,349 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, ASSIGN 2023-03-22 17:54:49,350 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:49,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-22 17:54:49,501 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1e4e986f562ee9fabc50018cd86c71ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:49,501 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679507689501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507689501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507689501"}]},"ts":"1679507689501"} 2023-03-22 17:54:49,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 1e4e986f562ee9fabc50018cd86c71ed, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:49,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-22 17:54:49,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e4e986f562ee9fabc50018cd86c71ed, NAME => 'testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:54:49,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-22 17:54:49,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-22 17:54:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,661 INFO [StoreOpener-1e4e986f562ee9fabc50018cd86c71ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,662 DEBUG [StoreOpener-1e4e986f562ee9fabc50018cd86c71ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1 2023-03-22 17:54:49,662 DEBUG [StoreOpener-1e4e986f562ee9fabc50018cd86c71ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1 2023-03-22 17:54:49,663 INFO [StoreOpener-1e4e986f562ee9fabc50018cd86c71ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e4e986f562ee9fabc50018cd86c71ed columnFamilyName f1 2023-03-22 17:54:49,664 INFO [StoreOpener-1e4e986f562ee9fabc50018cd86c71ed-1] regionserver.HStore(310): Store=1e4e986f562ee9fabc50018cd86c71ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:49,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:49,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:49,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e4e986f562ee9fabc50018cd86c71ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62313585, jitterRate=-0.0714552253484726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:54:49,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:49,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed., pid=73, masterSystemTime=1679507689654 2023-03-22 17:54:49,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:49,689 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1e4e986f562ee9fabc50018cd86c71ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:49,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679507689688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507689688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507689688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507689688"}]},"ts":"1679507689688"} 2023-03-22 17:54:49,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-22 17:54:49,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 1e4e986f562ee9fabc50018cd86c71ed, server=jenkins-hbase4.apache.org,46619,1679507617635 in 188 msec 2023-03-22 17:54:49,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-22 17:54:49,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, ASSIGN in 344 msec 2023-03-22 17:54:49,695 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:49,695 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507689695"}]},"ts":"1679507689695"} 2023-03-22 17:54:49,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-22 17:54:49,698 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:49,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 393 msec 2023-03-22 17:54:49,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-22 17:54:49,912 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-22 17:54:49,913 DEBUG [Listener at localhost/34365] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-22 17:54:49,915 INFO [Listener at localhost/34365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-22 17:54:49,928 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-22 17:54:49,928 INFO [Listener at localhost/34365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-22 17:54:49,929 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-22 17:54:49,933 INFO [Listener at localhost/34365] regionserver.HRegion(2745): Flushing 1e4e986f562ee9fabc50018cd86c71ed 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-22 17:54:49,945 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322cc2ee7c0d51942039a332f29c47bc3f0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322cc2ee7c0d51942039a332f29c47bc3f0 2023-03-22 17:54:49,950 INFO [Listener at localhost/34365] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp/f1/48ae0af843a64cb3a15b4d060b67803a 2023-03-22 17:54:49,955 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp/f1/48ae0af843a64cb3a15b4d060b67803a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a 2023-03-22 17:54:49,960 INFO [Listener at localhost/34365] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a, entries=1, sequenceid=5, filesize=4.9 K 2023-03-22 17:54:49,961 INFO [Listener at localhost/34365] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1e4e986f562ee9fabc50018cd86c71ed in 28ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:49,961 DEBUG [Listener at localhost/34365] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-22 17:54:49,962 DEBUG [Listener at localhost/34365] regionserver.HRegion(2446): Flush status journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:49,964 INFO [Listener at localhost/34365] regionserver.HRegion(2745): Flushing 1e4e986f562ee9fabc50018cd86c71ed 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-22 17:54:50,005 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322163cedc36549446cb8ad1112127eab6b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322163cedc36549446cb8ad1112127eab6b 2023-03-22 17:54:50,412 INFO [Listener at localhost/34365] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp/f1/80e413cb577f4a16b1f52578e70261e1 2023-03-22 17:54:50,417 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp/f1/80e413cb577f4a16b1f52578e70261e1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1 2023-03-22 17:54:50,422 INFO [Listener at localhost/34365] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1, entries=1, sequenceid=9, filesize=4.9 K 2023-03-22 17:54:50,423 INFO [Listener at localhost/34365] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1e4e986f562ee9fabc50018cd86c71ed in 459ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:50,423 DEBUG [Listener at localhost/34365] regionserver.HRegion(2446): Flush status journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:50,425 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-22 17:54:50,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-22 17:54:50,427 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-22 17:54:50,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:50,428 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508290428 2023-03-22 17:54:50,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:54:50,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-22 17:54:50,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-22 17:54:50,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x401560ac to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:50,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32260f05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:50,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230322 for table='testGetAfterCompaction' and column='f1' 2023-03-22 17:54:50,477 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,477 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,528 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,528 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,579 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,579 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,630 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,630 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,681 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,682 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,732 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,732 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,783 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,784 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,835 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,836 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,886 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,887 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,938 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,938 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,989 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:50,989 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,039 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,040 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,090 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,091 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,141 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,142 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,192 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,193 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,243 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,244 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,292 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303221707815c7d044ac3af23022649be055c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303221707815c7d044ac3af23022649be055c 2023-03-22 17:54:51,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testGetAfterCompaction' column='f1' 2023-03-22 17:54:51,295 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,295 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,311 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:51,312 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:51,328 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:54:51,331 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:54:51,346 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,346 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,358 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/f1/8d4f49ec64674f6786b7c93481815bd8 first=Optional[r1] last=Optional[r2] 2023-03-22 17:54:51,359 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{f1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/f1/8d4f49ec64674f6786b7c93481815bd8}] 2023-03-22 17:54:51,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/f1/8d4f49ec64674f6786b7c93481815bd8 for inclusion in 1e4e986f562ee9fabc50018cd86c71ed/f1 2023-03-22 17:54:51,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-22 17:54:51,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:54:51,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:51,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/f1/8d4f49ec64674f6786b7c93481815bd8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testGetAfterCompaction__2doa6ni8goc0i3vdqvk829hs5vn7bhr0r6vun5ksagb1fem43kc6r3jaqnmqhc24/f1/8d4f49ec64674f6786b7c93481815bd8 2023-03-22 17:54:51,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testGetAfterCompaction__2doa6ni8goc0i3vdqvk829hs5vn7bhr0r6vun5ksagb1fem43kc6r3jaqnmqhc24/f1/8d4f49ec64674f6786b7c93481815bd8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_ 2023-03-22 17:54:51,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testGetAfterCompaction__2doa6ni8goc0i3vdqvk829hs5vn7bhr0r6vun5ksagb1fem43kc6r3jaqnmqhc24/f1/8d4f49ec64674f6786b7c93481815bd8 into 1e4e986f562ee9fabc50018cd86c71ed/f1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_ - updating store file list. 2023-03-22 17:54:51,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_ into 1e4e986f562ee9fabc50018cd86c71ed/f1 2023-03-22 17:54:51,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testGetAfterCompaction__2doa6ni8goc0i3vdqvk829hs5vn7bhr0r6vun5ksagb1fem43kc6r3jaqnmqhc24/f1/8d4f49ec64674f6786b7c93481815bd8 into 1e4e986f562ee9fabc50018cd86c71ed/f1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_) 2023-03-22 17:54:51,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testGetAfterCompaction__2doa6ni8goc0i3vdqvk829hs5vn7bhr0r6vun5ksagb1fem43kc6r3jaqnmqhc24/f1/8d4f49ec64674f6786b7c93481815bd8 2023-03-22 17:54:51,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): 1e4e986f562ee9fabc50018cd86c71ed/f1 is initiating minor compaction 2023-03-22 17:54:51,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@169f2026; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:51,383 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1e4e986f562ee9fabc50018cd86c71ed/f1 in testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:51,383 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp, totalSize=10.0 K 2023-03-22 17:54:51,383 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 80e413cb577f4a16b1f52578e70261e1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:54:51,383 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting fdfb254ae21645499f884665b8ac703d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:54:51,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testGetAfterCompaction' column='f1' 2023-03-22 17:54:51,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:51,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322163cedc36549446cb8ad1112127eab6b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322163cedc36549446cb8ad1112127eab6b 2023-03-22 17:54:51,391 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322cc2ee7c0d51942039a332f29c47bc3f0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230322cc2ee7c0d51942039a332f29c47bc3f0 2023-03-22 17:54:51,391 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-22 17:54:51,391 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230322' 2023-03-22 17:54:51,391 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230322 for table='testGetAfterCompaction' and column='f1' 2023-03-22 17:54:51,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-22 17:54:51,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:54:51,392 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1e4e986f562ee9fabc50018cd86c71ed#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:54:51,397 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,397 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,397 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,401 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-22 17:54:51,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 975 msec 2023-03-22 17:54:51,406 DEBUG [Listener at localhost/34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-22 17:54:51,416 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-22 17:54:51,417 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46619] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:51,417 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-22 17:54:51,417 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-22 17:54:51,417 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46619] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-22 17:54:51,417 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46619] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. because compaction request was cancelled 2023-03-22 17:54:51,469 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,469 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,469 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,520 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,520 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,520 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,571 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,571 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,571 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,622 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,622 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,622 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,673 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,673 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,673 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,724 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,724 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,724 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,775 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,775 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,775 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,819 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/.tmp/f1/84b45acb7e834a5ca0ecd0ca6e9d130a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/84b45acb7e834a5ca0ecd0ca6e9d130a 2023-03-22 17:54:51,826 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,827 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507690412; access_time=1679507689967; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,827 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/84b45acb7e834a5ca0ecd0ca6e9d130a; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679507691814; access_time=1679507691389; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,827 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679507691288; access_time=1679507690453; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-22 17:54:51,828 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 1e4e986f562ee9fabc50018cd86c71ed/f1 of 1e4e986f562ee9fabc50018cd86c71ed into 84b45acb7e834a5ca0ecd0ca6e9d130a(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:54:51,828 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:51,828 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1679507691383; duration=0sec 2023-03-22 17:54:51,828 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:54:51,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_] to archive 2023-03-22 17:54:51,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:54:51,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/80e413cb577f4a16b1f52578e70261e1 2023-03-22 17:54:51,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/fdfb254ae21645499f884665b8ac703d_SeqId_12_ 2023-03-22 17:54:51,877 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679507689950; access_time=1679507689936; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,878 INFO [Listener at localhost/34365] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/84b45acb7e834a5ca0ecd0ca6e9d130a; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679507691814; access_time=1679507691389; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-22 17:54:51,998 INFO [Listener at localhost/34365] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-22 17:54:52,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-22 17:54:52,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,015 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507692015"}]},"ts":"1679507692015"} 2023-03-22 17:54:52,017 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-22 17:54:52,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-22 17:54:52,018 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-22 17:54:52,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, UNASSIGN}] 2023-03-22 17:54:52,021 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, UNASSIGN 2023-03-22 17:54:52,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e4e986f562ee9fabc50018cd86c71ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:52,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679507692022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507692022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507692022"}]},"ts":"1679507692022"} 2023-03-22 17:54:52,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 1e4e986f562ee9fabc50018cd86c71ed, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:52,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-22 17:54:52,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:52,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e4e986f562ee9fabc50018cd86c71ed, disabling compactions & flushes 2023-03-22 17:54:52,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:52,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:52,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. after waiting 0 ms 2023-03-22 17:54:52,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:52,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-22 17:54:52,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-22 17:54:52,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed. 2023-03-22 17:54:52,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e4e986f562ee9fabc50018cd86c71ed: 2023-03-22 17:54:52,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:52,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e4e986f562ee9fabc50018cd86c71ed, regionState=CLOSED 2023-03-22 17:54:52,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679507692182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507692182"}]},"ts":"1679507692182"} 2023-03-22 17:54:52,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-22 17:54:52,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 1e4e986f562ee9fabc50018cd86c71ed, server=jenkins-hbase4.apache.org,46619,1679507617635 in 161 msec 2023-03-22 17:54:52,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-22 17:54:52,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1e4e986f562ee9fabc50018cd86c71ed, UNASSIGN in 165 msec 2023-03-22 17:54:52,187 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507692187"}]},"ts":"1679507692187"} 2023-03-22 17:54:52,188 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-22 17:54:52,192 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-22 17:54:52,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 187 msec 2023-03-22 17:54:52,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-22 17:54:52,320 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-22 17:54:52,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-22 17:54:52,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,336 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-22 17:54:52,341 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:52,344 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1, FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/recovered.edits] 2023-03-22 17:54:52,349 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/48ae0af843a64cb3a15b4d060b67803a 2023-03-22 17:54:52,351 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/84b45acb7e834a5ca0ecd0ca6e9d130a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/f1/84b45acb7e834a5ca0ecd0ca6e9d130a 2023-03-22 17:54:52,354 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/recovered.edits/15.seqid to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed/recovered.edits/15.seqid 2023-03-22 17:54:52,355 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testGetAfterCompaction/1e4e986f562ee9fabc50018cd86c71ed 2023-03-22 17:54:52,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-22 17:54:52,355 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-22 17:54:52,356 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-22 17:54:52,360 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303221707815c7d044ac3af23022649be055c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303221707815c7d044ac3af23022649be055c 2023-03-22 17:54:52,361 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-22 17:54:52,363 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,396 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-22 17:54:52,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-22 17:54:52,403 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,403 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-22 17:54:52,403 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679507692403"}]},"ts":"9223372036854775807"} 2023-03-22 17:54:52,405 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-22 17:54:52,405 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1e4e986f562ee9fabc50018cd86c71ed, NAME => 'testGetAfterCompaction,,1679507689305.1e4e986f562ee9fabc50018cd86c71ed.', STARTKEY => '', ENDKEY => ''}] 2023-03-22 17:54:52,405 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-22 17:54:52,405 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1679507692405"}]},"ts":"9223372036854775807"} 2023-03-22 17:54:52,407 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-22 17:54:52,410 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-22 17:54:52,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 84 msec 2023-03-22 17:54:52,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-22 17:54:52,439 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-22 17:54:52,456 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251 (was 245) - Thread LEAK? -, OpenFileDescriptor=622 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 319) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6016 (was 6022) 2023-03-22 17:54:52,469 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=251, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=169, AvailableMemoryMB=6015 2023-03-22 17:54:52,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-22 17:54:52,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-22 17:54:52,474 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:54:52,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-22 17:54:52,475 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:54:52,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-22 17:54:52,478 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:54:52,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:52,478 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:52,480 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 empty. 2023-03-22 17:54:52,480 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 empty. 2023-03-22 17:54:52,481 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:54:52,481 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc empty. 2023-03-22 17:54:52,482 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:52,482 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:52,482 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-22 17:54:52,498 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-22 17:54:52,499 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 546a55e513840caf9aef078505d378c5, NAME => 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:52,500 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 62875c1cb9dc4a5947ba040718dc77cc, NAME => 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:52,505 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 72d334bfaccf92d12e3cc29b15536ea4, NAME => 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:54:52,545 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:52,545 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 72d334bfaccf92d12e3cc29b15536ea4, disabling compactions & flushes 2023-03-22 17:54:52,545 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:52,545 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:52,545 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. after waiting 0 ms 2023-03-22 17:54:52,546 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:52,546 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:52,546 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 62875c1cb9dc4a5947ba040718dc77cc, disabling compactions & flushes 2023-03-22 17:54:52,552 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. after waiting 0 ms 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:52,552 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:52,552 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:52,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-22 17:54:52,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 546a55e513840caf9aef078505d378c5, disabling compactions & flushes 2023-03-22 17:54:52,943 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. after waiting 0 ms 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:52,943 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:52,943 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:52,946 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:54:52,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507692946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507692946"}]},"ts":"1679507692946"} 2023-03-22 17:54:52,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507692946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507692946"}]},"ts":"1679507692946"} 2023-03-22 17:54:52,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507692946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507692946"}]},"ts":"1679507692946"} 2023-03-22 17:54:52,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-22 17:54:52,950 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:54:52,950 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507692950"}]},"ts":"1679507692950"} 2023-03-22 17:54:52,951 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-22 17:54:52,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN}] 2023-03-22 17:54:52,957 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN 2023-03-22 17:54:52,957 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN 2023-03-22 17:54:52,957 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN 2023-03-22 17:54:52,958 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:52,964 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:52,964 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:54:53,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-22 17:54:53,110 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,110 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507693110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507693110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507693110"}]},"ts":"1679507693110"} 2023-03-22 17:54:53,110 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,110 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507693110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507693110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507693110"}]},"ts":"1679507693110"} 2023-03-22 17:54:53,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507693110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507693110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507693110"}]},"ts":"1679507693110"} 2023-03-22 17:54:53,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:53,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:53,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:54:53,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:53,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 546a55e513840caf9aef078505d378c5, NAME => 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.', STARTKEY => '', ENDKEY => '1'} 2023-03-22 17:54:53,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:53,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,277 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,278 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:54:53,278 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:54:53,279 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546a55e513840caf9aef078505d378c5 columnFamilyName family1 2023-03-22 17:54:53,280 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(310): Store=546a55e513840caf9aef078505d378c5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,281 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,282 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2 2023-03-22 17:54:53,282 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2 2023-03-22 17:54:53,283 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546a55e513840caf9aef078505d378c5 columnFamilyName family2 2023-03-22 17:54:53,284 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(310): Store=546a55e513840caf9aef078505d378c5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:53,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 546a55e513840caf9aef078505d378c5 2023-03-22 17:54:53,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:53,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 546a55e513840caf9aef078505d378c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65923045, jitterRate=-0.017670080065727234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:53,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:53,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., pid=83, masterSystemTime=1679507693269 2023-03-22 17:54:53,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:53,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:53,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:53,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72d334bfaccf92d12e3cc29b15536ea4, NAME => 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.', STARTKEY => '2', ENDKEY => ''} 2023-03-22 17:54:53,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,299 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:53,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,299 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507693298"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507693298"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507693298"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507693298"}]},"ts":"1679507693298"} 2023-03-22 17:54:53,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,300 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,302 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:54:53,302 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:54:53,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-03-22 17:54:53,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635 in 188 msec 2023-03-22 17:54:53,303 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72d334bfaccf92d12e3cc29b15536ea4 columnFamilyName family1 2023-03-22 17:54:53,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN in 348 msec 2023-03-22 17:54:53,304 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(310): Store=72d334bfaccf92d12e3cc29b15536ea4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,305 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,307 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2 2023-03-22 17:54:53,307 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2 2023-03-22 17:54:53,307 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72d334bfaccf92d12e3cc29b15536ea4 columnFamilyName family2 2023-03-22 17:54:53,308 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(310): Store=72d334bfaccf92d12e3cc29b15536ea4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:53,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:54:53,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:53,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72d334bfaccf92d12e3cc29b15536ea4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63601519, jitterRate=-0.05226351320743561}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:53,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:53,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., pid=84, masterSystemTime=1679507693269 2023-03-22 17:54:53,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:53,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:53,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:53,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62875c1cb9dc4a5947ba040718dc77cc, NAME => 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.', STARTKEY => '1', ENDKEY => '2'} 2023-03-22 17:54:53,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:54:53,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,342 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507693342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507693342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507693342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507693342"}]},"ts":"1679507693342"} 2023-03-22 17:54:53,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-22 17:54:53,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635 in 231 msec 2023-03-22 17:54:53,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN in 390 msec 2023-03-22 17:54:53,352 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,374 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:54:53,374 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:54:53,375 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62875c1cb9dc4a5947ba040718dc77cc columnFamilyName family1 2023-03-22 17:54:53,376 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(310): Store=62875c1cb9dc4a5947ba040718dc77cc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,377 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,378 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2 2023-03-22 17:54:53,378 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2 2023-03-22 17:54:53,379 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62875c1cb9dc4a5947ba040718dc77cc columnFamilyName family2 2023-03-22 17:54:53,380 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(310): Store=62875c1cb9dc4a5947ba040718dc77cc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:54:53,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:54:53,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:54:53,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:54:53,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62875c1cb9dc4a5947ba040718dc77cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65902359, jitterRate=-0.017978325486183167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:54:53,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:53,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., pid=85, masterSystemTime=1679507693269 2023-03-22 17:54:53,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:53,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:53,411 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507693411"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507693411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507693411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507693411"}]},"ts":"1679507693411"} 2023-03-22 17:54:53,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-03-22 17:54:53,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 298 msec 2023-03-22 17:54:53,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-22 17:54:53,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN in 460 msec 2023-03-22 17:54:53,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:54:53,417 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507693417"}]},"ts":"1679507693417"} 2023-03-22 17:54:53,418 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-22 17:54:53,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:54:53,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 951 msec 2023-03-22 17:54:53,531 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-22 17:54:53,581 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-22 17:54:53,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:53,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:53,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:53,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:53,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-22 17:54:53,642 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-22 17:54:53,642 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:53,642 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-22 17:54:53,642 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-22 17:54:53,643 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:53,643 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:53,645 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,645 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:53,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:53,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:53,646 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:53,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:53,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-22 17:54:53,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-22 17:54:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-22 17:54:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-22 17:54:53,660 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:53,660 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:53,663 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 546a55e513840caf9aef078505d378c5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:54:53,664 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:53,664 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:53,664 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:53,664 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:53,664 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:53,664 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:53,665 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 72d334bfaccf92d12e3cc29b15536ea4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:54:53,673 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 62875c1cb9dc4a5947ba040718dc77cc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:54:54,110 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 2023-03-22 17:54:54,117 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/734ac5af4ab5473ba3375d7190893c23 2023-03-22 17:54:54,118 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 2023-03-22 17:54:54,125 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 2023-03-22 17:54:54,127 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/3f209649afb54ddfb84368a7279a5eb1 2023-03-22 17:54:54,134 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/15bc2d88d42f448eb388e02defef96c3 2023-03-22 17:54:54,136 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53 2023-03-22 17:54:54,147 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58 2023-03-22 17:54:54,168 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c 2023-03-22 17:54:54,171 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/60d5ecdb925749e8abf85d53ae0c25c6 2023-03-22 17:54:54,174 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 2023-03-22 17:54:54,176 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/3f209649afb54ddfb84368a7279a5eb1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1 2023-03-22 17:54:54,179 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/15bc2d88d42f448eb388e02defef96c3 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3 2023-03-22 17:54:54,180 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:54:54,181 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/60d5ecdb925749e8abf85d53ae0c25c6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6 2023-03-22 17:54:54,184 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:54:54,184 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 2023-03-22 17:54:54,186 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:54:54,186 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 72d334bfaccf92d12e3cc29b15536ea4 in 521ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:54,187 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-22 17:54:54,187 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:54,187 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:54,187 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:54,189 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:54:54,190 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 62875c1cb9dc4a5947ba040718dc77cc in 518ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:54,191 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:54,191 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:54,191 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:54,564 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/655a1a41bbb144f580d09b040711178e 2023-03-22 17:54:54,569 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/734ac5af4ab5473ba3375d7190893c23 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23 2023-03-22 17:54:54,572 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:54:54,573 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/655a1a41bbb144f580d09b040711178e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e 2023-03-22 17:54:54,577 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:54:54,578 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 546a55e513840caf9aef078505d378c5 in 915ms, sequenceid=5, compaction requested=false 2023-03-22 17:54:54,578 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:54,578 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-22 17:54:54,578 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-22 17:54:54,580 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,580 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:54,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:54,581 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:54,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-22 17:54:54,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2286e600[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:54,582 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-22 17:54:54,582 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,583 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,584 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-22 17:54:54,584 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-22 17:54:54,584 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:54,584 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,584 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:54,585 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-22 17:54:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-22 17:54:54,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:54,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-22 17:54:54,587 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-22 17:54:54,587 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:54,587 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:54,587 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-22 17:54:54,587 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:54,590 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,590 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:54,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,590 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:54,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:54,591 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,592 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,594 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:54,594 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:54,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:54,594 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-22 17:54:54,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:54,594 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:54,594 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:54,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:54,595 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:54,695 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:54,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:54,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:54,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:54,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:54,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:54,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-22 17:54:54,712 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-22 17:54:54,712 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:54,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-22 17:54:54,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-22 17:54:54,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,713 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:54,715 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:54,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:54,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:54,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:54,715 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:54,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:54,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:54,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:54,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:54,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-22 17:54:54,728 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-22 17:54:54,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-22 17:54:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-22 17:54:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-22 17:54:54,732 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:54,732 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:54,732 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 546a55e513840caf9aef078505d378c5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:54:54,740 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:54,740 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:54,740 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:54,740 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 72d334bfaccf92d12e3cc29b15536ea4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:54:54,740 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:54,740 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:54,740 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 62875c1cb9dc4a5947ba040718dc77cc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:54:55,191 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b 2023-03-22 17:54:55,202 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/f64a555940ff423a8cf421e88ef3f4bc 2023-03-22 17:54:55,208 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc 2023-03-22 17:54:55,213 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 2023-03-22 17:54:55,274 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 2023-03-22 17:54:55,274 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/5580763adde149abb98f8a5f6922048f 2023-03-22 17:54:55,291 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8 2023-03-22 17:54:55,325 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578 2023-03-22 17:54:55,343 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec 2023-03-22 17:54:55,353 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/93588c990e4d48b3a4b969e7a3b59fa5 2023-03-22 17:54:55,357 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/5580763adde149abb98f8a5f6922048f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f 2023-03-22 17:54:55,361 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:54:55,362 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/93588c990e4d48b3a4b969e7a3b59fa5 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5 2023-03-22 17:54:55,366 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:54:55,367 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 546a55e513840caf9aef078505d378c5 in 635ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:55,367 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:55,367 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:55,368 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:55,723 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/888a14edb062474f8cd6e938b7b7967f 2023-03-22 17:54:55,728 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/f64a555940ff423a8cf421e88ef3f4bc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc 2023-03-22 17:54:55,731 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:54:55,732 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/888a14edb062474f8cd6e938b7b7967f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f 2023-03-22 17:54:55,736 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:54:55,737 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 62875c1cb9dc4a5947ba040718dc77cc in 997ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:55,737 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:55,737 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:55,740 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/9d687bab2dc945cfbbd34098ca67b984 2023-03-22 17:54:55,745 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 2023-03-22 17:54:55,749 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:54:55,750 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/9d687bab2dc945cfbbd34098ca67b984 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984 2023-03-22 17:54:55,755 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:54:55,756 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 72d334bfaccf92d12e3cc29b15536ea4 in 1016ms, sequenceid=9, compaction requested=false 2023-03-22 17:54:55,756 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:55,756 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-22 17:54:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-22 17:54:55,758 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,758 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:55,758 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,758 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:55,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-22 17:54:55,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9173619[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:55,760 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-22 17:54:55,760 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,763 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-22 17:54:55,763 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,763 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-22 17:54:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:55,765 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-22 17:54:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-22 17:54:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:55,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-22 17:54:55,767 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-22 17:54:55,768 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:55,768 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:55,768 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-22 17:54:55,768 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:55,769 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,769 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,769 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:55,770 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,771 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:55,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:55,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,773 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,773 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:55,773 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:55,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:55,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-22 17:54:55,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:55,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:55,774 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:55,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:55,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:55,774 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:55,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-22 17:54:55,874 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:55,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:55,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:55,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:55,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:55,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-22 17:54:55,883 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-22 17:54:55,883 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:55,883 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-22 17:54:55,883 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-22 17:54:55,884 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,884 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:55,885 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:55,885 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:55,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:55,885 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:55,885 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:55,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:55,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:55,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-22 17:54:55,886 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-22 17:54:55,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-22 17:54:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-22 17:54:55,887 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:55,887 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-22 17:54:55,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:55,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:55,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:55,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:55,887 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 546a55e513840caf9aef078505d378c5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:54:55,887 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 72d334bfaccf92d12e3cc29b15536ea4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:54:55,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:55,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:55,892 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:55,892 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:55,892 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 62875c1cb9dc4a5947ba040718dc77cc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:54:55,917 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 2023-03-22 17:54:55,922 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/2c09b33de1be4a24b2edac559979c864 2023-03-22 17:54:55,940 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e 2023-03-22 17:54:56,317 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 2023-03-22 17:54:56,320 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 2023-03-22 17:54:56,347 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/26e10695602d460f9791ea5549d7aae0 2023-03-22 17:54:56,352 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/2c09b33de1be4a24b2edac559979c864 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864 2023-03-22 17:54:56,356 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:54:56,357 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/26e10695602d460f9791ea5549d7aae0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0 2023-03-22 17:54:56,361 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:54:56,362 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 62875c1cb9dc4a5947ba040718dc77cc in 470ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:56,362 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:56,362 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:56,362 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:56,725 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/9a5534a5a27844ca96484af563e83007 2023-03-22 17:54:56,730 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/f71ce6ceefee44658c58695ceb150609 2023-03-22 17:54:56,744 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8 2023-03-22 17:54:57,148 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad 2023-03-22 17:54:57,149 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/594a280063e3423e98a1350bfbb08a49 2023-03-22 17:54:57,155 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/cda58a834ef34e45929770ebdac6ede6 2023-03-22 17:54:57,159 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/9a5534a5a27844ca96484af563e83007 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007 2023-03-22 17:54:57,160 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/f71ce6ceefee44658c58695ceb150609 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609 2023-03-22 17:54:57,165 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:54:57,166 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/594a280063e3423e98a1350bfbb08a49 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49 2023-03-22 17:54:57,167 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:54:57,168 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/cda58a834ef34e45929770ebdac6ede6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6 2023-03-22 17:54:57,170 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:54:57,171 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 72d334bfaccf92d12e3cc29b15536ea4 in 1284ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:57,172 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:57,172 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:57,172 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:57,173 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:54:57,180 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 546a55e513840caf9aef078505d378c5 in 1287ms, sequenceid=13, compaction requested=true 2023-03-22 17:54:57,180 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:57,180 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:57,180 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:57,180 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:57,180 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,180 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-22 17:54:57,180 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-22 17:54:57,182 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,182 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:57,183 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,183 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:57,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-22 17:54:57,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70107f56[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:57,184 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-22 17:54:57,184 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,186 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,186 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-22 17:54:57,186 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-22 17:54:57,186 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,186 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:57,186 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-22 17:54:57,188 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:57,189 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:57,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-22 17:54:57,192 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-22 17:54:57,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:57,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:57,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-22 17:54:57,192 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:57,200 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,200 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:57,200 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:57,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,200 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:57,201 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:57,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,204 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:57,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-22 17:54:57,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:57,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:57,204 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:57,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-22 17:54:57,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:57,305 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:57,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:57,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:57,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:57,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:54:57,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-22 17:54:57,320 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-22 17:54:57,320 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:57,320 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-22 17:54:57,320 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-22 17:54:57,321 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,321 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:57,322 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:57,322 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:57,322 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:57,322 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:57,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:57,323 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-22 17:54:57,324 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-22 17:54:57,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-22 17:54:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-22 17:54:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:57,324 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 546a55e513840caf9aef078505d378c5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:57,324 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:57,324 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 62875c1cb9dc4a5947ba040718dc77cc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:54:57,325 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 72d334bfaccf92d12e3cc29b15536ea4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:54:57,358 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 2023-03-22 17:54:57,365 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 2023-03-22 17:54:57,377 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/c9f78d8dbbc24f88aadc357960d9f8b6 2023-03-22 17:54:57,753 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 2023-03-22 17:54:57,770 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/36a50fb4e4e44cb39f99725902c9f2b4 2023-03-22 17:54:57,783 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd 2023-03-22 17:54:57,826 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce 2023-03-22 17:54:57,833 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/8a3bbbff9b1e409980247caaaf5d88af 2023-03-22 17:54:57,838 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/c9f78d8dbbc24f88aadc357960d9f8b6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6 2023-03-22 17:54:57,843 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:54:57,844 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/8a3bbbff9b1e409980247caaaf5d88af as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af 2023-03-22 17:54:57,849 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:54:57,850 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 62875c1cb9dc4a5947ba040718dc77cc in 525ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:57,850 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:57,850 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:57,850 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:54:58,161 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 2023-03-22 17:54:58,176 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962 2023-03-22 17:54:58,185 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/6ed2c53c9fef410fa232b1f10375f9f1 2023-03-22 17:54:58,189 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 2023-03-22 17:54:58,190 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/bfdb74b39e4c4d819063a11caba0d627 2023-03-22 17:54:58,194 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:54:58,195 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/6ed2c53c9fef410fa232b1f10375f9f1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1 2023-03-22 17:54:58,196 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/36a50fb4e4e44cb39f99725902c9f2b4 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4 2023-03-22 17:54:58,199 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:54:58,200 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/bfdb74b39e4c4d819063a11caba0d627 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627 2023-03-22 17:54:58,200 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:54:58,201 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 546a55e513840caf9aef078505d378c5 in 877ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:58,201 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:58,201 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:58,201 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:54:58,206 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:54:58,207 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 72d334bfaccf92d12e3cc29b15536ea4 in 882ms, sequenceid=17, compaction requested=true 2023-03-22 17:54:58,207 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:58,207 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:54:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:54:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-22 17:54:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-22 17:54:58,209 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-22 17:54:58,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7da7bd0e[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:58,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-22 17:54:58,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,213 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-22 17:54:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-22 17:54:58,214 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:58,214 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,214 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:58,216 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-22 17:54:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:58,216 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-22 17:54:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:58,219 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-22 17:54:58,219 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:58,219 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:58,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-22 17:54:58,219 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-22 17:54:58,219 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:54:58,221 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,221 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,221 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:54:58,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:54:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,224 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,225 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-22 17:54:58,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:54:58,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:58,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:54:58,228 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:58,228 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:58,229 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:58,229 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:54:58,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:54:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:54:58,329 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:54:58,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:54:58,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:54:58,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679507698344 (current time:1679507698344). 2023-03-22 17:54:58,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-22 17:54:58,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] zookeeper.ReadOnlyZKClient(139): Connect 0x2fcf7989 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:54:58,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41d1032c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:54:58,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:54:58,377 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54364, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:54:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fcf7989 to 127.0.0.1:60739 2023-03-22 17:54:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:58,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-22 17:54:58,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:54:58,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:54:58,394 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:54:58,395 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679508298395 2023-03-22 17:54:58,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:54:58,395 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1679507698330 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-22 17:54:58,396 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:54:58,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-22 17:54:58,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-22 17:54:58,398 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-22 17:54:58,399 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1679508298399 2023-03-22 17:54:58,401 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-22 17:54:58,401 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-22 17:54:58,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1679507698330 2023-03-22 17:54:58,417 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1679507698330' 2023-03-22 17:54:58,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-22 17:54:58,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1679507698330' starting 'acquire' 2023-03-22 17:54:58,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1679507698330', kicking off acquire phase on members. 2023-03-22 17:54:58,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,418 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1679507698330 2023-03-22 17:54:58,419 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-22 17:54:58,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-22 17:54:58,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-22 17:54:58,420 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,420 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,420 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:58,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1679507698330 2023-03-22 17:54:58,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-22 17:54:58,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1679507698330 2023-03-22 17:54:58,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1679507698330 from table testCompactionWithHFileLink type FLUSH 2023-03-22 17:54:58,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1679507698330 2023-03-22 17:54:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1679507698330' with timeout 300000ms 2023-03-22 17:54:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-22 17:54:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1679507698330' starting 'acquire' stage 2023-03-22 17:54:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1679507698330' locally acquired 2023-03-22 17:54:58,424 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (snaptb-1679507698330) in zk 2023-03-22 17:54:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,426 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-22 17:54:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1679507698330' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:54:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'snaptb-1679507698330' on coordinator 2023-03-22 17:54:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6804f25c[Count = 0] remaining members to acquire global barrier 2023-03-22 17:54:58,428 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1679507698330' starting 'in-barrier' execution. 2023-03-22 17:54:58,428 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,429 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,429 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1679507698330' received 'reached' from coordinator. 2023-03-22 17:54:58,430 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,430 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:54:58,430 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:58,430 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:58,431 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:58,431 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:58,431 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:58,431 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:54:58,432 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.' region-info for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,432 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.' region-info for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,438 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-22 17:54:58,438 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-22 17:54:58,439 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-22 17:54:58,439 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:58,439 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-22 17:54:58,439 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:58,439 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:54:58,440 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.' region-info for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,440 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4] hfiles 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6] hfiles 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3] hfiles 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,442 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1] hfiles 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627] hfiles 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af] hfiles 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,446 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,447 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627 for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,501 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:54:58,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:54:58,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:54:58,506 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-22 17:54:58,707 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:54:58,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:54:58,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:54:58,708 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-22 17:54:58,776 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:54:58,867 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. completed. 2023-03-22 17:54:58,867 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:58,867 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. completed. 2023-03-22 17:54:58,867 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:58,868 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. completed. 2023-03-22 17:54:58,868 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1679507698330' locally completed 2023-03-22 17:54:58,868 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1679507698330' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:54:58,870 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1679507698330' has notified controller of completion 2023-03-22 17:54:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-22 17:54:58,870 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:58,871 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1679507698330' completed. 2023-03-22 17:54:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1679507698330' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:54:58,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'snaptb-1679507698330', counting down latch. Waiting for 0 more 2023-03-22 17:54:58,873 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1679507698330' execution completed 2023-03-22 17:54:58,874 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:54:58,874 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:54:58,874 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1679507698330 2023-03-22 17:54:58,874 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1679507698330including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-22 17:54:58,876 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,876 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-22 17:54:58,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-22 17:54:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-22 17:54:58,876 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:54:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-22 17:54:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:54:58,877 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:54:58,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,879 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:54:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679507698330 2023-03-22 17:54:58,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679507698330 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679507698330 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679507698330/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:58,882 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:54:58,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1679507698330 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-22 17:54:58,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679507698330 2023-03-22 17:54:58,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-22 17:54:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-22 17:54:58,882 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-22 17:54:58,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1679507698330 2023-03-22 17:54:58,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679507698330 2023-03-22 17:54:58,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-22 17:54:58,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-22 17:54:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716] mob files 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 2023-03-22 17:54:58,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec] mob files 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad 2023-03-22 17:54:58,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec 2023-03-22 17:54:58,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1679507698330 2023-03-22 17:54:58,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/snaptb-1679507698330 2023-03-22 17:54:59,008 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:54:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:54:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:54:59,009 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-22 17:54:59,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/snaptb-1679507698330 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/snaptb-1679507698330 2023-03-22 17:54:59,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1679507698330 of table testCompactionWithHFileLink completed 2023-03-22 17:54:59,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/snaptb-1679507698330 2023-03-22 17:54:59,450 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/snaptb-1679507698330 2023-03-22 17:54:59,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1679507698330 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679507698395Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1679507698902 (+507 ms)Consolidate snapshot: snaptb-1679507698330 at 1679507698902Loading Region manifests for snaptb-1679507698330 at 1679507698902Writing data manifest for snaptb-1679507698330 at 1679507698929 (+27 ms)Verifying snapshot: snaptb-1679507698330 at 1679507699350 (+421 ms)Snapshot snaptb-1679507698330 of table testCompactionWithHFileLink completed at 1679507699449 (+99 ms) 2023-03-22 17:54:59,454 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-22 17:54:59,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.0570 sec 2023-03-22 17:54:59,510 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:54:59,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:54:59,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-22 17:54:59,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:54:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-22 17:54:59,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-22 17:54:59,549 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-22 17:54:59,549 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:59,549 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-22 17:54:59,549 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-22 17:54:59,550 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:59,550 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:59,552 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:54:59,552 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:59,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:54:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:54:59,552 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:54:59,552 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:54:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:59,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:54:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:54:59,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-22 17:54:59,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-22 17:54:59,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-22 17:54:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-22 17:54:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:54:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-22 17:54:59,556 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:59,556 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. started... 2023-03-22 17:54:59,556 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 546a55e513840caf9aef078505d378c5 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:54:59,557 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:54:59,557 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. started... 2023-03-22 17:54:59,557 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:54:59,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 72d334bfaccf92d12e3cc29b15536ea4 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:54:59,557 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:54:59,557 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:54:59,557 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. started... 2023-03-22 17:54:59,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 62875c1cb9dc4a5947ba040718dc77cc 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:54:59,668 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/2282317e0a5c408a99989c7903687398 2023-03-22 17:54:59,671 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28 2023-03-22 17:54:59,674 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2282317e0a5c408a99989c7903687398 2023-03-22 17:54:59,678 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a30dcaf1e8814b5b80aa2ddc8c25ec28 2023-03-22 17:54:59,686 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/3ead1b7f16ea45ce9f62e1b833ca0224 2023-03-22 17:54:59,692 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ead1b7f16ea45ce9f62e1b833ca0224 2023-03-22 17:54:59,764 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/b6da2a9858bf482b9fc4f79c48f2f256 2023-03-22 17:54:59,812 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c0f0d86 to 127.0.0.1:60739 2023-03-22 17:54:59,812 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:59,812 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:59,812 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x401560ac to 127.0.0.1:60739 2023-03-22 17:54:59,812 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:59,812 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:59,812 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b63b065 to 127.0.0.1:60739 2023-03-22 17:54:59,813 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:59,813 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:54:59,813 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c1c5d93 to 127.0.0.1:60739 2023-03-22 17:54:59,813 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:54:59,816 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6da2a9858bf482b9fc4f79c48f2f256 2023-03-22 17:54:59,817 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28 2023-03-22 17:54:59,822 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a30dcaf1e8814b5b80aa2ddc8c25ec28 2023-03-22 17:54:59,822 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28, entries=3, sequenceid=24, filesize=5.0 K 2023-03-22 17:54:59,823 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/b6da2a9858bf482b9fc4f79c48f2f256 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256 2023-03-22 17:54:59,827 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6da2a9858bf482b9fc4f79c48f2f256 2023-03-22 17:54:59,827 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256, entries=1, sequenceid=24, filesize=5.0 K 2023-03-22 17:54:59,828 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 546a55e513840caf9aef078505d378c5 in 272ms, sequenceid=24, compaction requested=true 2023-03-22 17:54:59,828 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:54:59,829 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:54:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:00,148 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/e329b34ad8364d8db362bdaaf661a6d0 2023-03-22 17:55:00,153 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e329b34ad8364d8db362bdaaf661a6d0 2023-03-22 17:55:00,153 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/2282317e0a5c408a99989c7903687398 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398 2023-03-22 17:55:00,157 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2282317e0a5c408a99989c7903687398 2023-03-22 17:55:00,157 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398, entries=3, sequenceid=24, filesize=5.0 K 2023-03-22 17:55:00,158 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/e329b34ad8364d8db362bdaaf661a6d0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0 2023-03-22 17:55:00,162 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e329b34ad8364d8db362bdaaf661a6d0 2023-03-22 17:55:00,162 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0, entries=1, sequenceid=24, filesize=5.0 K 2023-03-22 17:55:00,163 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 72d334bfaccf92d12e3cc29b15536ea4 in 606ms, sequenceid=24, compaction requested=true 2023-03-22 17:55:00,163 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:00,163 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:00,163 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:00,630 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/3bd6c939d6f84c93bed38c367f56a671 2023-03-22 17:55:00,635 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bd6c939d6f84c93bed38c367f56a671 2023-03-22 17:55:00,636 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/3ead1b7f16ea45ce9f62e1b833ca0224 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224 2023-03-22 17:55:00,640 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ead1b7f16ea45ce9f62e1b833ca0224 2023-03-22 17:55:00,640 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224, entries=3, sequenceid=24, filesize=5.0 K 2023-03-22 17:55:00,641 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/3bd6c939d6f84c93bed38c367f56a671 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671 2023-03-22 17:55:00,645 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bd6c939d6f84c93bed38c367f56a671 2023-03-22 17:55:00,645 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671, entries=1, sequenceid=24, filesize=5.0 K 2023-03-22 17:55:00,646 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 62875c1cb9dc4a5947ba040718dc77cc in 1089ms, sequenceid=24, compaction requested=true 2023-03-22 17:55:00,646 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:00,646 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-22 17:55:00,646 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-22 17:55:00,648 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,648 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:00,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-22 17:55:00,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5813b6bb[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:00,650 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-22 17:55:00,651 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,655 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,655 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,655 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-22 17:55:00,655 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-22 17:55:00,655 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:00,655 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:00,657 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-22 17:55:00,657 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,657 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:00,657 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-22 17:55:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:00,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:00,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-22 17:55:00,660 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-22 17:55:00,660 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:00,660 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:00,660 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-22 17:55:00,660 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:00,662 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,662 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:00,662 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:00,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:00,663 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:00,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,664 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:00,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-22 17:55:00,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,666 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,666 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:55:00,666 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-22 17:55:00,667 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:00,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-22 17:55:00,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-22 17:55:00,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:00,667 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:00,668 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:00,668 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:00,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:00,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:00,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:00,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:00,767 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:00,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:00,769 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:00,770 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 546a55e513840caf9aef078505d378c5/family1 is initiating major compaction (all files) 2023-03-22 17:55:00,770 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:00,770 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:00,771 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 546a55e513840caf9aef078505d378c5/family1 in testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:00,771 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp, totalSize=26.7 K 2023-03-22 17:55:00,771 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 734ac5af4ab5473ba3375d7190893c23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693633 2023-03-22 17:55:00,772 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 5580763adde149abb98f8a5f6922048f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:00,772 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting f71ce6ceefee44658c58695ceb150609, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:00,773 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting ac28f88f5cf54e49a8d0adf7189bb3e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:00,773 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting a30dcaf1e8814b5b80aa2ddc8c25ec28, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:00,801 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 546a55e513840caf9aef078505d378c5#family1#compaction#107 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:01,232 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del 2023-03-22 17:55:01,232 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del 2023-03-22 17:55:01,246 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1551f775d94e0b9806ec56bef7939a 2023-03-22 17:55:01,247 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/3f1551f775d94e0b9806ec56bef7939a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/3f1551f775d94e0b9806ec56bef7939a 2023-03-22 17:55:01,252 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1551f775d94e0b9806ec56bef7939a 2023-03-22 17:55:01,253 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 546a55e513840caf9aef078505d378c5/family1 of 546a55e513840caf9aef078505d378c5 into 3f1551f775d94e0b9806ec56bef7939a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:01,253 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:01,253 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:01,253 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 546a55e513840caf9aef078505d378c5/family2 is initiating major compaction (all files) 2023-03-22 17:55:01,253 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:01,253 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:01,256 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 546a55e513840caf9aef078505d378c5/family2 in testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:01,256 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp, totalSize=25.4 K 2023-03-22 17:55:01,256 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 655a1a41bbb144f580d09b040711178e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693633 2023-03-22 17:55:01,257 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 93588c990e4d48b3a4b969e7a3b59fa5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:01,258 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting cda58a834ef34e45929770ebdac6ede6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:01,258 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 6ed2c53c9fef410fa232b1f10375f9f1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:01,259 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting b6da2a9858bf482b9fc4f79c48f2f256, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:01,283 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 546a55e513840caf9aef078505d378c5#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:01,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28] to archive 2023-03-22 17:55:01,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:01,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/734ac5af4ab5473ba3375d7190893c23 2023-03-22 17:55:01,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/5580763adde149abb98f8a5f6922048f 2023-03-22 17:55:01,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f71ce6ceefee44658c58695ceb150609 2023-03-22 17:55:01,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/ac28f88f5cf54e49a8d0adf7189bb3e3 2023-03-22 17:55:01,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/a30dcaf1e8814b5b80aa2ddc8c25ec28 2023-03-22 17:55:01,697 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del 2023-03-22 17:55:01,697 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del 2023-03-22 17:55:02,513 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3b40510772d460581f12a07a5858ff5 2023-03-22 17:55:02,514 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/a3b40510772d460581f12a07a5858ff5 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a3b40510772d460581f12a07a5858ff5 2023-03-22 17:55:02,518 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3b40510772d460581f12a07a5858ff5 2023-03-22 17:55:02,518 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 546a55e513840caf9aef078505d378c5/family2 of 546a55e513840caf9aef078505d378c5 into a3b40510772d460581f12a07a5858ff5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:02,519 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:02,519 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:02,519 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 72d334bfaccf92d12e3cc29b15536ea4/family1 is initiating major compaction (all files) 2023-03-22 17:55:02,519 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:02,519 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:02,520 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 72d334bfaccf92d12e3cc29b15536ea4/family1 in testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:02,520 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp, totalSize=26.7 K 2023-03-22 17:55:02,520 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 3f209649afb54ddfb84368a7279a5eb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693635 2023-03-22 17:55:02,521 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 945d21b5cd9f4b7fbcd693c8d6a4da24, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:02,521 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 9a5534a5a27844ca96484af563e83007, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:02,521 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 36a50fb4e4e44cb39f99725902c9f2b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:02,522 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 2282317e0a5c408a99989c7903687398, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:02,537 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 72d334bfaccf92d12e3cc29b15536ea4#family1#compaction#109 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:02,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256] to archive 2023-03-22 17:55:02,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:02,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/655a1a41bbb144f580d09b040711178e 2023-03-22 17:55:02,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/93588c990e4d48b3a4b969e7a3b59fa5 2023-03-22 17:55:02,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/cda58a834ef34e45929770ebdac6ede6 2023-03-22 17:55:02,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/6ed2c53c9fef410fa232b1f10375f9f1 2023-03-22 17:55:02,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/b6da2a9858bf482b9fc4f79c48f2f256 2023-03-22 17:55:02,961 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del 2023-03-22 17:55:02,961 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del 2023-03-22 17:55:03,788 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41cd446c8ed448baa08b041a47c6f465 2023-03-22 17:55:03,789 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/41cd446c8ed448baa08b041a47c6f465 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/41cd446c8ed448baa08b041a47c6f465 2023-03-22 17:55:03,800 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41cd446c8ed448baa08b041a47c6f465 2023-03-22 17:55:03,801 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 72d334bfaccf92d12e3cc29b15536ea4/family1 of 72d334bfaccf92d12e3cc29b15536ea4 into 41cd446c8ed448baa08b041a47c6f465(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:03,802 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:03,802 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:03,802 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 72d334bfaccf92d12e3cc29b15536ea4/family2 is initiating major compaction (all files) 2023-03-22 17:55:03,802 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:03,802 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:03,803 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 72d334bfaccf92d12e3cc29b15536ea4/family2 in testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:03,803 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp, totalSize=25.4 K 2023-03-22 17:55:03,804 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 60d5ecdb925749e8abf85d53ae0c25c6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693635 2023-03-22 17:55:03,804 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 9d687bab2dc945cfbbd34098ca67b984, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:03,805 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 594a280063e3423e98a1350bfbb08a49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:03,805 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting bfdb74b39e4c4d819063a11caba0d627, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:03,805 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e329b34ad8364d8db362bdaaf661a6d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:03,821 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 72d334bfaccf92d12e3cc29b15536ea4#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:03,831 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del 2023-03-22 17:55:03,831 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del 2023-03-22 17:55:03,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398] to archive 2023-03-22 17:55:03,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:03,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/3f209649afb54ddfb84368a7279a5eb1 2023-03-22 17:55:03,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/945d21b5cd9f4b7fbcd693c8d6a4da24 2023-03-22 17:55:03,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/9a5534a5a27844ca96484af563e83007 2023-03-22 17:55:03,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/36a50fb4e4e44cb39f99725902c9f2b4 2023-03-22 17:55:03,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/2282317e0a5c408a99989c7903687398 2023-03-22 17:55:04,245 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d251ed483f44362bfe592208ed1849b 2023-03-22 17:55:04,246 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/4d251ed483f44362bfe592208ed1849b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/4d251ed483f44362bfe592208ed1849b 2023-03-22 17:55:04,250 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d251ed483f44362bfe592208ed1849b 2023-03-22 17:55:04,251 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 72d334bfaccf92d12e3cc29b15536ea4/family2 of 72d334bfaccf92d12e3cc29b15536ea4 into 4d251ed483f44362bfe592208ed1849b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:04,251 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:04,251 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:04,251 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 62875c1cb9dc4a5947ba040718dc77cc/family1 is initiating major compaction (all files) 2023-03-22 17:55:04,251 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:04,251 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:04,252 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 62875c1cb9dc4a5947ba040718dc77cc/family1 in testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:04,252 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp, totalSize=26.7 K 2023-03-22 17:55:04,252 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 15bc2d88d42f448eb388e02defef96c3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693634 2023-03-22 17:55:04,253 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting f64a555940ff423a8cf421e88ef3f4bc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:04,253 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 2c09b33de1be4a24b2edac559979c864, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:04,254 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting c9f78d8dbbc24f88aadc357960d9f8b6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:04,254 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 3ead1b7f16ea45ce9f62e1b833ca0224, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:04,270 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 62875c1cb9dc4a5947ba040718dc77cc#family1#compaction#111 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:04,278 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del 2023-03-22 17:55:04,278 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del 2023-03-22 17:55:04,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0] to archive 2023-03-22 17:55:04,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:04,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/60d5ecdb925749e8abf85d53ae0c25c6 2023-03-22 17:55:04,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/9d687bab2dc945cfbbd34098ca67b984 2023-03-22 17:55:04,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/594a280063e3423e98a1350bfbb08a49 2023-03-22 17:55:04,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/bfdb74b39e4c4d819063a11caba0d627 2023-03-22 17:55:04,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/e329b34ad8364d8db362bdaaf661a6d0 2023-03-22 17:55:05,102 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5efdc95bb71457ca168a9983ae3befc 2023-03-22 17:55:05,103 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/c5efdc95bb71457ca168a9983ae3befc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c5efdc95bb71457ca168a9983ae3befc 2023-03-22 17:55:05,107 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5efdc95bb71457ca168a9983ae3befc 2023-03-22 17:55:05,110 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 62875c1cb9dc4a5947ba040718dc77cc/family1 of 62875c1cb9dc4a5947ba040718dc77cc into c5efdc95bb71457ca168a9983ae3befc(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:05,110 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:05,110 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:05,110 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 62875c1cb9dc4a5947ba040718dc77cc/family2 is initiating major compaction (all files) 2023-03-22 17:55:05,110 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:05,111 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:05,111 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 62875c1cb9dc4a5947ba040718dc77cc/family2 in testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:05,112 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp, totalSize=25.4 K 2023-03-22 17:55:05,112 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting ce83bd13b75d47efa0aa8a3cb56f39b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693634 2023-03-22 17:55:05,113 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 888a14edb062474f8cd6e938b7b7967f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:05,115 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 26e10695602d460f9791ea5549d7aae0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:05,115 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 8a3bbbff9b1e409980247caaaf5d88af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:05,115 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 3bd6c939d6f84c93bed38c367f56a671, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-22 17:55:05,131 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 62875c1cb9dc4a5947ba040718dc77cc#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:05,138 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del 2023-03-22 17:55:05,138 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del 2023-03-22 17:55:05,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224] to archive 2023-03-22 17:55:05,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:05,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/15bc2d88d42f448eb388e02defef96c3 2023-03-22 17:55:05,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/f64a555940ff423a8cf421e88ef3f4bc 2023-03-22 17:55:05,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/2c09b33de1be4a24b2edac559979c864 2023-03-22 17:55:05,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c9f78d8dbbc24f88aadc357960d9f8b6 2023-03-22 17:55:05,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/3ead1b7f16ea45ce9f62e1b833ca0224 2023-03-22 17:55:05,953 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28d4c9fca924656844e7d271a3d3d4c 2023-03-22 17:55:05,953 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/c28d4c9fca924656844e7d271a3d3d4c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/c28d4c9fca924656844e7d271a3d3d4c 2023-03-22 17:55:05,958 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28d4c9fca924656844e7d271a3d3d4c 2023-03-22 17:55:05,959 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 62875c1cb9dc4a5947ba040718dc77cc/family2 of 62875c1cb9dc4a5947ba040718dc77cc into c28d4c9fca924656844e7d271a3d3d4c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:05,959 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:05,964 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:05,967 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:05,972 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:05,974 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:05,982 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:55:06,026 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-22 17:55:06,030 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del 2023-03-22 17:55:06,034 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del 2023-03-22 17:55:06,037 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del 2023-03-22 17:55:06,037 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,038 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(139): Connect 0x7406c696 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:06,044 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19e4741, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:06,045 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:06,045 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:06,045 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:06,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671] to archive 2023-03-22 17:55:06,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:06,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/ce83bd13b75d47efa0aa8a3cb56f39b7 2023-03-22 17:55:06,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/888a14edb062474f8cd6e938b7b7967f 2023-03-22 17:55:06,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/26e10695602d460f9791ea5549d7aae0 2023-03-22 17:55:06,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/8a3bbbff9b1e409980247caaaf5d88af 2023-03-22 17:55:06,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/3bd6c939d6f84c93bed38c367f56a671 2023-03-22 17:55:06,174 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b 2023-03-22 17:55:06,176 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,193 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:06,197 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49618, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:06,206 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:55:06,209 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:55:06,219 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/8574809b8d154e1f89e50a126b55de78 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-22 17:55:06,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/8574809b8d154e1f89e50a126b55de78}] 2023-03-22 17:55:06,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/8574809b8d154e1f89e50a126b55de78 for inclusion in 546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-22 17:55:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last=1 2023-03-22 17:55:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:06,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/8574809b8d154e1f89e50a126b55de78 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__pmgfe3gro910o4htg1qqq148cuj0aetjbbd4tlllvipndg4p152tbre9nrb9qa55/family1/8574809b8d154e1f89e50a126b55de78 2023-03-22 17:55:06,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__pmgfe3gro910o4htg1qqq148cuj0aetjbbd4tlllvipndg4p152tbre9nrb9qa55/family1/8574809b8d154e1f89e50a126b55de78 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ 2023-03-22 17:55:06,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__pmgfe3gro910o4htg1qqq148cuj0aetjbbd4tlllvipndg4p152tbre9nrb9qa55/family1/8574809b8d154e1f89e50a126b55de78 into 546a55e513840caf9aef078505d378c5/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ - updating store file list. 2023-03-22 17:55:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ into 546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__pmgfe3gro910o4htg1qqq148cuj0aetjbbd4tlllvipndg4p152tbre9nrb9qa55/family1/8574809b8d154e1f89e50a126b55de78 into 546a55e513840caf9aef078505d378c5/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_) 2023-03-22 17:55:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__pmgfe3gro910o4htg1qqq148cuj0aetjbbd4tlllvipndg4p152tbre9nrb9qa55/family1/8574809b8d154e1f89e50a126b55de78 2023-03-22 17:55:06,235 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,236 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:06,237 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 2023-03-22 17:55:06,238 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc 2023-03-22 17:55:06,239 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 2023-03-22 17:55:06,240 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 2023-03-22 17:55:06,240 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:06,240 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322' 2023-03-22 17:55:06,241 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:06,552 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce 2023-03-22 17:55:06,553 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,586 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/fdc882f0cf5d4f82a6a409e6b1459c4e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-22 17:55:06,588 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/fdc882f0cf5d4f82a6a409e6b1459c4e}] 2023-03-22 17:55:06,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/fdc882f0cf5d4f82a6a409e6b1459c4e for inclusion in 62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-22 17:55:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-22 17:55:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:06,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/fdc882f0cf5d4f82a6a409e6b1459c4e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__6vpe8to1469n35p01ou01na44f3pastfvf6qtaqb7o71vbp4s5lq3nemfeq5c8ac/family1/fdc882f0cf5d4f82a6a409e6b1459c4e 2023-03-22 17:55:06,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__6vpe8to1469n35p01ou01na44f3pastfvf6qtaqb7o71vbp4s5lq3nemfeq5c8ac/family1/fdc882f0cf5d4f82a6a409e6b1459c4e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ 2023-03-22 17:55:06,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__6vpe8to1469n35p01ou01na44f3pastfvf6qtaqb7o71vbp4s5lq3nemfeq5c8ac/family1/fdc882f0cf5d4f82a6a409e6b1459c4e into 62875c1cb9dc4a5947ba040718dc77cc/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ - updating store file list. 2023-03-22 17:55:06,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ into 62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:06,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__6vpe8to1469n35p01ou01na44f3pastfvf6qtaqb7o71vbp4s5lq3nemfeq5c8ac/family1/fdc882f0cf5d4f82a6a409e6b1459c4e into 62875c1cb9dc4a5947ba040718dc77cc/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_) 2023-03-22 17:55:06,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__6vpe8to1469n35p01ou01na44f3pastfvf6qtaqb7o71vbp4s5lq3nemfeq5c8ac/family1/fdc882f0cf5d4f82a6a409e6b1459c4e 2023-03-22 17:55:06,612 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,612 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:06,615 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b 2023-03-22 17:55:06,617 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 2023-03-22 17:55:06,623 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 2023-03-22 17:55:06,625 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 2023-03-22 17:55:06,625 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:06,625 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322' 2023-03-22 17:55:06,625 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:06,965 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d 2023-03-22 17:55:06,966 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:06,993 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/5559e988db674a23929a11b27f9ab345 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-22 17:55:06,993 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/5559e988db674a23929a11b27f9ab345}] 2023-03-22 17:55:06,995 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/5559e988db674a23929a11b27f9ab345 for inclusion in 72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-22 17:55:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-22 17:55:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:06,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/5559e988db674a23929a11b27f9ab345 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__n9bdjghqudvm77m44mlr9d8scv6gmh4d3srfv8v0uampcjgr6totqivd09r0rl1a/family1/5559e988db674a23929a11b27f9ab345 2023-03-22 17:55:07,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__n9bdjghqudvm77m44mlr9d8scv6gmh4d3srfv8v0uampcjgr6totqivd09r0rl1a/family1/5559e988db674a23929a11b27f9ab345 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ 2023-03-22 17:55:07,001 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__n9bdjghqudvm77m44mlr9d8scv6gmh4d3srfv8v0uampcjgr6totqivd09r0rl1a/family1/5559e988db674a23929a11b27f9ab345 into 72d334bfaccf92d12e3cc29b15536ea4/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ - updating store file list. 2023-03-22 17:55:07,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ into 72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:07,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__n9bdjghqudvm77m44mlr9d8scv6gmh4d3srfv8v0uampcjgr6totqivd09r0rl1a/family1/5559e988db674a23929a11b27f9ab345 into 72d334bfaccf92d12e3cc29b15536ea4/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_) 2023-03-22 17:55:07,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__n9bdjghqudvm77m44mlr9d8scv6gmh4d3srfv8v0uampcjgr6totqivd09r0rl1a/family1/5559e988db674a23929a11b27f9ab345 2023-03-22 17:55:07,006 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:07,007 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:07,008 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 2023-03-22 17:55:07,009 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 2023-03-22 17:55:07,010 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 2023-03-22 17:55:07,011 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 2023-03-22 17:55:07,011 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:07,011 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322' 2023-03-22 17:55:07,012 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:07,012 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:07,012 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:07,012 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del] 2023-03-22 17:55:07,013 DEBUG [Listener at localhost/34365] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:07,014 DEBUG [Listener at localhost/34365] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322d4a6d872c4504f519e237078e23fe92c_del 2023-03-22 17:55:07,014 INFO [Listener at localhost/34365] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-22 17:55:07,014 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del] 2023-03-22 17:55:07,014 DEBUG [Listener at localhost/34365] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:07,016 DEBUG [Listener at localhost/34365] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303222913811b125c412c9e7225c7398bc0a5_del 2023-03-22 17:55:07,016 INFO [Listener at localhost/34365] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-22 17:55:07,016 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del] 2023-03-22 17:55:07,016 DEBUG [Listener at localhost/34365] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:07,017 DEBUG [Listener at localhost/34365] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230322007404087c264695be481971e99b89f5_del 2023-03-22 17:55:07,018 INFO [Listener at localhost/34365] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-22 17:55:07,020 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:07,022 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:07,026 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:07,028 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:07,034 INFO [Listener at localhost/34365] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-22 17:55:07,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-22 17:55:07,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-22 17:55:07,038 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507707038"}]},"ts":"1679507707038"} 2023-03-22 17:55:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-22 17:55:07,039 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-22 17:55:07,042 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-22 17:55:07,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, UNASSIGN}] 2023-03-22 17:55:07,044 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, UNASSIGN 2023-03-22 17:55:07,044 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, UNASSIGN 2023-03-22 17:55:07,044 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, UNASSIGN 2023-03-22 17:55:07,045 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:07,045 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:07,045 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507707045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507707045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507707045"}]},"ts":"1679507707045"} 2023-03-22 17:55:07,045 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507707045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507707045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507707045"}]},"ts":"1679507707045"} 2023-03-22 17:55:07,045 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:07,046 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507707045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507707045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507707045"}]},"ts":"1679507707045"} 2023-03-22 17:55:07,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:07,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:07,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:07,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-22 17:55:07,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:07,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62875c1cb9dc4a5947ba040718dc77cc, disabling compactions & flushes 2023-03-22 17:55:07,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:07,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:07,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. after waiting 0 ms 2023-03-22 17:55:07,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:07,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-22 17:55:07,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:07,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:07,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:07,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:07,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 546a55e513840caf9aef078505d378c5, disabling compactions & flushes 2023-03-22 17:55:07,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:07,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:07,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. after waiting 0 ms 2023-03-22 17:55:07,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:07,212 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=CLOSED 2023-03-22 17:55:07,212 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507707212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507707212"}]},"ts":"1679507707212"} 2023-03-22 17:55:07,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-22 17:55:07,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:07,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:07,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-22 17:55:07,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 167 msec 2023-03-22 17:55:07,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:07,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:07,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72d334bfaccf92d12e3cc29b15536ea4, disabling compactions & flushes 2023-03-22 17:55:07,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:07,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:07,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. after waiting 0 ms 2023-03-22 17:55:07,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:07,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=CLOSED 2023-03-22 17:55:07,219 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507707218"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507707218"}]},"ts":"1679507707218"} 2023-03-22 17:55:07,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, UNASSIGN in 174 msec 2023-03-22 17:55:07,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-22 17:55:07,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:07,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:07,418 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:07,418 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-22 17:55:07,419 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7406c696 to 127.0.0.1:60739 2023-03-22 17:55:07,419 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:07,419 INFO [AsyncFSWAL-0-hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8-prefix:jenkins-hbase4.apache.org,46619,1679507617635.meta] wal.AbstractFSWAL(1045): Slow sync cost: 195 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK]] 2023-03-22 17:55:07,420 INFO [AsyncFSWAL-0-hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData-prefix:jenkins-hbase4.apache.org,40261,1679507616391] wal.AbstractFSWAL(1045): Slow sync cost: 195 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-477aa431-9838-4d3b-9414-3bd42bde2593,DISK]] 2023-03-22 17:55:07,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:07,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-22 17:55:07,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=CLOSED 2023-03-22 17:55:07,425 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507707425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507707425"}]},"ts":"1679507707425"} 2023-03-22 17:55:07,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-03-22 17:55:07,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635 in 364 msec 2023-03-22 17:55:07,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, UNASSIGN in 383 msec 2023-03-22 17:55:07,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-03-22 17:55:07,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635 in 380 msec 2023-03-22 17:55:07,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-03-22 17:55:07,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, UNASSIGN in 385 msec 2023-03-22 17:55:07,431 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507707430"}]},"ts":"1679507707430"} 2023-03-22 17:55:07,432 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-22 17:55:07,434 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-22 17:55:07,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 399 msec 2023-03-22 17:55:07,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-22 17:55:07,722 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-22 17:55:07,737 INFO [Listener at localhost/34365] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:07,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:55:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679507707738 (current time:1679507707738). 2023-03-22 17:55:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-22 17:55:07,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] zookeeper.ReadOnlyZKClient(139): Connect 0x7fcb2595 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:07,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f521764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:07,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:07,767 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:07,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fcb2595 to 127.0.0.1:60739 2023-03-22 17:55:07,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-22 17:55:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:55:07,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:55:07,775 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:55:07,775 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679508307775 2023-03-22 17:55:07,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:55:07,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1679507698330-1679507707737 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-22 17:55:07,776 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:07,776 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-22 17:55:07,876 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:55:07,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:55:07,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:55:07,877 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-22 17:55:08,078 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:55:08,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:55:08,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:55:08,079 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-22 17:55:08,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-22 17:55:08,205 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-22 17:55:08,206 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-22 17:55:08,206 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-22 17:55:08,206 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-22 17:55:08,205 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-22 17:55:08,205 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-22 17:55:08,206 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-22 17:55:08,206 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/3f1551f775d94e0b9806ec56bef7939a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_] hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/3f1551f775d94e0b9806ec56bef7939a 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c5efdc95bb71457ca168a9983ae3befc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_] hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c5efdc95bb71457ca168a9983ae3befc 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/41cd446c8ed448baa08b041a47c6f465] hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b] hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/41cd446c8ed448baa08b041a47c6f465 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a3b40510772d460581f12a07a5858ff5] hfiles 2023-03-22 17:55:08,209 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a3b40510772d460581f12a07a5858ff5 2023-03-22 17:55:08,210 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/c28d4c9fca924656844e7d271a3d3d4c] hfiles 2023-03-22 17:55:08,210 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/c28d4c9fca924656844e7d271a3d3d4c 2023-03-22 17:55:08,210 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/4d251ed483f44362bfe592208ed1849b] hfiles 2023-03-22 17:55:08,210 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/4d251ed483f44362bfe592208ed1849b 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec] hfiles 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221d704e532ec24eed96f8fdbe829f317c 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303224a647ad8d4d04848aecbea90e76634f8 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322a222338bf13245b4ac0acf8b69115e3e 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230322f641d8184429426d8079d39cbf55b4ce 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303227eece15915724be7894b8b84492003fd 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322a065ca76bc7e42888722cdc2a4627578 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322af8efe63b81542c598a750950401fd58 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230322bffc4d8a02db4c8bbbd69c7f8bae65f8 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032285fd0693e1bd4f2b924a9a9c810de962 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322eccf0bb8195c474883b3c6c56e601c53 2023-03-22 17:55:08,215 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fa6d54b6e396416d8e89b78b1fdcd9ad 2023-03-22 17:55:08,216 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230322fce5c9da8a7845a49423b5b827a56bec 2023-03-22 17:55:08,379 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:55:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:55:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:55:08,380 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-22 17:55:08,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-22 17:55:08,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:08,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:08,880 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:55:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:55:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-22 17:55:08,882 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-22 17:55:09,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679507698330-1679507707737 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:09,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1679507698330-1679507707737 of table testCompactionWithHFileLink completed 2023-03-22 17:55:09,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:09,464 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:09,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1679507698330-1679507707737 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679507707775Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1679507708204 (+429 ms)Consolidate snapshot: hbase-failsafe-snaptb-1679507698330-1679507707737 at 1679507708623 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1679507698330-1679507707737 at 1679507708623Writing data manifest for hbase-failsafe-snaptb-1679507698330-1679507707737 at 1679507708626 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1679507698330-1679507707737 at 1679507709032 (+406 ms)Snapshot hbase-failsafe-snaptb-1679507698330-1679507707737 of table testCompactionWithHFileLink completed at 1679507709464 (+432 ms) 2023-03-22 17:55:09,465 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-22 17:55:09,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6930 sec 2023-03-22 17:55:09,882 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-22 17:55:09,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-22 17:55:09,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1679507698330-1679507707737 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-22 17:55:09,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679507698330" table: "testCompactionWithHFileLink" creation_time: 1679507698344 type: FLUSH version: 2 ttl: 0 ) 2023-03-22 17:55:09,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1679507698330 as table=testCompactionWithHFileLink 2023-03-22 17:55:09,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-22 17:55:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-22 17:55:10,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-22 17:55:10,328 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-22 17:55:10,329 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-22 17:55:10,329 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-22 17:55:10,330 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-22 17:55:10,334 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1679507698330" table: "testCompactionWithHFileLink" creation_time: 1679507698344 type: FLUSH version: 2 ttl: 0 2023-03-22 17:55:10,334 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink 2023-03-22 17:55:10,339 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-22 17:55:10,343 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023032278bd39864df249be86589cb8d3b3db5d 2023-03-22 17:55:10,344 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230322ee720ab0d53f4db49ce65197dd938cce 2023-03-22 17:55:10,345 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230322906389100f134d7bad7b040ad9c9f42b 2023-03-22 17:55:10,345 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,348 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,351 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,354 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,356 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,359 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,361 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,363 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,366 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,368 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,371 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,374 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 of snapshot=snaptb-1679507698330 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,378 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303221e2041d0fca543e6ba3ff7df54ac0a69_del 2023-03-22 17:55:10,379 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303226785846a38334cb29ae992991a7eb742_del 2023-03-22 17:55:10,380 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023032260403f124f804e3f8c2065b7f37da3bd_del 2023-03-22 17:55:10,380 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:10,380 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,380 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:10,386 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/3f1551f775d94e0b9806ec56bef7939a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/3f1551f775d94e0b9806ec56bef7939a 2023-03-22 17:55:10,386 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/07ae0f4dfb654d5b8f39b50f5f063015_SeqId_29_ 2023-03-22 17:55:10,386 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/e5765355f4ee47b0b390f8efdc221319_SeqId_29_ 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/abefc163c5244d988e105f506b22a40c_SeqId_29_ 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 734ac5af4ab5473ba3375d7190893c23 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/41cd446c8ed448baa08b041a47c6f465 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/41cd446c8ed448baa08b041a47c6f465 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3f209649afb54ddfb84368a7279a5eb1 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c5efdc95bb71457ca168a9983ae3befc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/c5efdc95bb71457ca168a9983ae3befc 2023-03-22 17:55:10,388 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 15bc2d88d42f448eb388e02defef96c3 of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,391 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5580763adde149abb98f8a5f6922048f of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,391 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f64a555940ff423a8cf421e88ef3f4bc of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,391 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 945d21b5cd9f4b7fbcd693c8d6a4da24 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,395 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f71ce6ceefee44658c58695ceb150609 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,395 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9a5534a5a27844ca96484af563e83007 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,395 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2c09b33de1be4a24b2edac559979c864 of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,398 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac28f88f5cf54e49a8d0adf7189bb3e3 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,398 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 36a50fb4e4e44cb39f99725902c9f2b4 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,399 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9f78d8dbbc24f88aadc357960d9f8b6 of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,403 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/4d251ed483f44362bfe592208ed1849b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/4d251ed483f44362bfe592208ed1849b 2023-03-22 17:55:10,403 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 60d5ecdb925749e8abf85d53ae0c25c6 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,403 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a3b40510772d460581f12a07a5858ff5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a3b40510772d460581f12a07a5858ff5 2023-03-22 17:55:10,403 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 655a1a41bbb144f580d09b040711178e of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,406 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/c28d4c9fca924656844e7d271a3d3d4c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/c28d4c9fca924656844e7d271a3d3d4c 2023-03-22 17:55:10,406 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9d687bab2dc945cfbbd34098ca67b984 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,406 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ce83bd13b75d47efa0aa8a3cb56f39b7 of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,407 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 93588c990e4d48b3a4b969e7a3b59fa5 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,420 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 594a280063e3423e98a1350bfbb08a49 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,420 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 888a14edb062474f8cd6e938b7b7967f of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,420 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cda58a834ef34e45929770ebdac6ede6 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,423 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bfdb74b39e4c4d819063a11caba0d627 of snapshot=snaptb-1679507698330 to region=72d334bfaccf92d12e3cc29b15536ea4 table=testCompactionWithHFileLink 2023-03-22 17:55:10,423 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 26e10695602d460f9791ea5549d7aae0 of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,424 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ed2c53c9fef410fa232b1f10375f9f1 of snapshot=snaptb-1679507698330 to region=546a55e513840caf9aef078505d378c5 table=testCompactionWithHFileLink 2023-03-22 17:55:10,426 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8a3bbbff9b1e409980247caaaf5d88af of snapshot=snaptb-1679507698330 to region=62875c1cb9dc4a5947ba040718dc77cc table=testCompactionWithHFileLink 2023-03-22 17:55:10,429 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1679507698330" table: "testCompactionWithHFileLink" creation_time: 1679507698344 type: FLUSH version: 2 ttl: 0 2023-03-22 17:55:10,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679507710430"}]},"ts":"9223372036854775807"} 2023-03-22 17:55:10,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679507710430"}]},"ts":"9223372036854775807"} 2023-03-22 17:55:10,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679507710430"}]},"ts":"9223372036854775807"} 2023-03-22 17:55:10,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-22 17:55:10,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 546a55e513840caf9aef078505d378c5, NAME => 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 62875c1cb9dc4a5947ba040718dc77cc, NAME => 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 72d334bfaccf92d12e3cc29b15536ea4, NAME => 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.', STARTKEY => '2', ENDKEY => ''}] 2023-03-22 17:55:10,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507710431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507710431"}]},"ts":"1679507710431"} 2023-03-22 17:55:10,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507710431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507710431"}]},"ts":"1679507710431"} 2023-03-22 17:55:10,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507710431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507710431"}]},"ts":"1679507710431"} 2023-03-22 17:55:10,434 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-22 17:55:10,434 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-22 17:55:10,434 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 546a55e513840caf9aef078505d378c5, NAME => 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 62875c1cb9dc4a5947ba040718dc77cc, NAME => 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 72d334bfaccf92d12e3cc29b15536ea4, NAME => 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.', STARTKEY => '2', ENDKEY => ''}] 2023-03-22 17:55:10,434 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1679507698330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-22 17:55:10,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679507698330" table: "testCompactionWithHFileLink" creation_time: 1679507698344 type: FLUSH version: 2 ttl: 0 ) in 525 msec 2023-03-22 17:55:10,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-22 17:55:10,525 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-22 17:55:10,525 INFO [Listener at localhost/34365] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:10,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1679507698330-1679507707737" 2023-03-22 17:55:10,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1679507698330-1679507707737 2023-03-22 17:55:10,533 INFO [Listener at localhost/34365] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-22 17:55:10,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-22 17:55:10,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-22 17:55:10,545 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-22 17:55:10,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-22 17:55:10,545 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507710545"}]},"ts":"1679507710545"} 2023-03-22 17:55:10,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-22 17:55:10,550 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-22 17:55:10,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN}] 2023-03-22 17:55:10,551 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN 2023-03-22 17:55:10,551 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN 2023-03-22 17:55:10,551 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN 2023-03-22 17:55:10,552 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-22 17:55:10,552 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-22 17:55:10,552 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-22 17:55:10,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-22 17:55:10,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:10,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:10,703 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:10,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507710703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507710703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507710703"}]},"ts":"1679507710703"} 2023-03-22 17:55:10,703 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507710703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507710703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507710703"}]},"ts":"1679507710703"} 2023-03-22 17:55:10,703 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507710703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507710703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507710703"}]},"ts":"1679507710703"} 2023-03-22 17:55:10,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:10,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:10,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:10,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-22 17:55:10,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:10,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62875c1cb9dc4a5947ba040718dc77cc, NAME => 'testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.', STARTKEY => '1', ENDKEY => '2'} 2023-03-22 17:55:10,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:10,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,860 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,861 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:10,861 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:10,861 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62875c1cb9dc4a5947ba040718dc77cc columnFamilyName family1 2023-03-22 17:55:10,875 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3 2023-03-22 17:55:10,881 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864 2023-03-22 17:55:10,885 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6 2023-03-22 17:55:10,891 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc 2023-03-22 17:55:10,891 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(310): Store=62875c1cb9dc4a5947ba040718dc77cc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:10,891 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,892 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2 2023-03-22 17:55:10,892 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2 2023-03-22 17:55:10,893 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62875c1cb9dc4a5947ba040718dc77cc columnFamilyName family2 2023-03-22 17:55:10,901 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0 2023-03-22 17:55:10,906 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f 2023-03-22 17:55:10,910 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af 2023-03-22 17:55:10,916 DEBUG [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7 2023-03-22 17:55:10,917 INFO [StoreOpener-62875c1cb9dc4a5947ba040718dc77cc-1] regionserver.HStore(310): Store=62875c1cb9dc4a5947ba040718dc77cc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:10,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:10,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:10,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62875c1cb9dc4a5947ba040718dc77cc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72025789, jitterRate=0.07326789200305939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:10,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:10,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., pid=103, masterSystemTime=1679507710856 2023-03-22 17:55:10,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:10,925 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-22 17:55:10,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-22 17:55:10,925 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:10,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:10,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72d334bfaccf92d12e3cc29b15536ea4, NAME => 'testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.', STARTKEY => '2', ENDKEY => ''} 2023-03-22 17:55:10,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=62875c1cb9dc4a5947ba040718dc77cc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:10,927 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507710927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507710927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507710927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507710927"}]},"ts":"1679507710927"} 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:10,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:10,929 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-22 17:55:10,929 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1912): 62875c1cb9dc4a5947ba040718dc77cc/family1 is initiating minor compaction (all files) 2023-03-22 17:55:10,929 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 62875c1cb9dc4a5947ba040718dc77cc/family1 in testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:10,929 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp, totalSize=21.6 K 2023-03-22 17:55:10,929 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-22 17:55:10,930 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1912): 62875c1cb9dc4a5947ba040718dc77cc/family2 is initiating minor compaction (all files) 2023-03-22 17:55:10,930 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 62875c1cb9dc4a5947ba040718dc77cc/family2 in testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:10,930 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp, totalSize=20.4 K 2023-03-22 17:55:10,930 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693634 2023-03-22 17:55:10,930 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:10,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-22 17:55:10,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 62875c1cb9dc4a5947ba040718dc77cc, server=jenkins-hbase4.apache.org,46619,1679507617635 in 223 msec 2023-03-22 17:55:10,931 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693634 2023-03-22 17:55:10,931 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:10,932 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:10,932 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:10,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=62875c1cb9dc4a5947ba040718dc77cc, ASSIGN in 381 msec 2023-03-22 17:55:10,932 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:10,932 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72d334bfaccf92d12e3cc29b15536ea4 columnFamilyName family1 2023-03-22 17:55:10,933 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:10,933 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:10,934 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:10,934 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:10,960 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4 2023-03-22 17:55:10,969 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1 2023-03-22 17:55:10,981 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24 2023-03-22 17:55:10,986 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] throttle.PressureAwareThroughputController(145): 62875c1cb9dc4a5947ba040718dc77cc#family2#compaction#114 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:10,995 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 62875c1cb9dc4a5947ba040718dc77cc#family1#compaction#113 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:10,996 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007 2023-03-22 17:55:10,999 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(310): Store=72d334bfaccf92d12e3cc29b15536ea4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:10,999 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:11,000 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2 2023-03-22 17:55:11,001 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2 2023-03-22 17:55:11,001 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72d334bfaccf92d12e3cc29b15536ea4 columnFamilyName family2 2023-03-22 17:55:11,010 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49 2023-03-22 17:55:11,014 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6 2023-03-22 17:55:11,024 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984 2023-03-22 17:55:11,028 DEBUG [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627 2023-03-22 17:55:11,032 INFO [StoreOpener-72d334bfaccf92d12e3cc29b15536ea4-1] regionserver.HStore(310): Store=72d334bfaccf92d12e3cc29b15536ea4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:11,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:11,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:11,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:11,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:11,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72d334bfaccf92d12e3cc29b15536ea4; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65903297, jitterRate=-0.017964348196983337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:11,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:11,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., pid=102, masterSystemTime=1679507710856 2023-03-22 17:55:11,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-22 17:55:11,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:11,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:11,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 546a55e513840caf9aef078505d378c5, NAME => 'testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.', STARTKEY => '', ENDKEY => '1'} 2023-03-22 17:55:11,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=72d334bfaccf92d12e3cc29b15536ea4, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507711039"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507711039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507711039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507711039"}]},"ts":"1679507711039"} 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-03-22 17:55:11,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 72d334bfaccf92d12e3cc29b15536ea4, server=jenkins-hbase4.apache.org,46619,1679507617635 in 335 msec 2023-03-22 17:55:11,042 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=72d334bfaccf92d12e3cc29b15536ea4, ASSIGN in 492 msec 2023-03-22 17:55:11,043 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:11,043 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:11,043 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546a55e513840caf9aef078505d378c5 columnFamilyName family1 2023-03-22 17:55:11,049 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f 2023-03-22 17:55:11,053 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23 2023-03-22 17:55:11,057 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3 2023-03-22 17:55:11,061 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609 2023-03-22 17:55:11,061 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(310): Store=546a55e513840caf9aef078505d378c5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:11,062 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,062 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2 2023-03-22 17:55:11,062 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2 2023-03-22 17:55:11,063 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 546a55e513840caf9aef078505d378c5 columnFamilyName family2 2023-03-22 17:55:11,068 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e 2023-03-22 17:55:11,072 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1 2023-03-22 17:55:11,078 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5 2023-03-22 17:55:11,083 DEBUG [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(539): loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6 2023-03-22 17:55:11,083 INFO [StoreOpener-546a55e513840caf9aef078505d378c5-1] regionserver.HStore(310): Store=546a55e513840caf9aef078505d378c5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:11,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:11,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:11,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 546a55e513840caf9aef078505d378c5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73043043, jitterRate=0.08842615783214569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:11,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:11,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., pid=101, masterSystemTime=1679507710856 2023-03-22 17:55:11,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-22 17:55:11,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-22 17:55:11,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:11,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:11,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=546a55e513840caf9aef078505d378c5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:11,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679507711090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507711090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507711090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507711090"}]},"ts":"1679507711090"} 2023-03-22 17:55:11,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-03-22 17:55:11,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 546a55e513840caf9aef078505d378c5, server=jenkins-hbase4.apache.org,46619,1679507617635 in 387 msec 2023-03-22 17:55:11,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-03-22 17:55:11,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=546a55e513840caf9aef078505d378c5, ASSIGN in 543 msec 2023-03-22 17:55:11,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507711095"}]},"ts":"1679507711095"} 2023-03-22 17:55:11,096 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-22 17:55:11,097 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-22 17:55:11,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 560 msec 2023-03-22 17:55:11,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-22 17:55:11,148 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-22 17:55:11,158 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:11,164 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:11,172 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:11,173 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:11,179 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:55:11,193 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-22 17:55:11,193 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:11,194 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(139): Connect 0x0f1f0589 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:11,198 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a243fca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:11,199 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:11,199 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:11,199 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:11,284 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303229837bb1cacf045a790663ccdb38f582d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303229837bb1cacf045a790663ccdb38f582d 2023-03-22 17:55:11,285 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:11,297 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:11,301 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:11,308 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:55:11,311 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:55:11,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/b444f776d6104f5ca4ac52ed5c889005 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-22 17:55:11,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/b444f776d6104f5ca4ac52ed5c889005}] 2023-03-22 17:55:11,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/b444f776d6104f5ca4ac52ed5c889005 for inclusion in 62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-22 17:55:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-22 17:55:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:11,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322/family1/b444f776d6104f5ca4ac52ed5c889005 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__2gemrbb467iuukooergj6gu43qlej74e7h485g76hkb23jt984m96fqe032l7diu/family1/b444f776d6104f5ca4ac52ed5c889005 2023-03-22 17:55:11,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__2gemrbb467iuukooergj6gu43qlej74e7h485g76hkb23jt984m96fqe032l7diu/family1/b444f776d6104f5ca4ac52ed5c889005 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/fbae551d2aa74fa5b11c381201f0acb6_SeqId_34_ 2023-03-22 17:55:11,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__2gemrbb467iuukooergj6gu43qlej74e7h485g76hkb23jt984m96fqe032l7diu/family1/b444f776d6104f5ca4ac52ed5c889005 into 62875c1cb9dc4a5947ba040718dc77cc/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/fbae551d2aa74fa5b11c381201f0acb6_SeqId_34_ - updating store file list. 2023-03-22 17:55:11,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/fbae551d2aa74fa5b11c381201f0acb6_SeqId_34_ into 62875c1cb9dc4a5947ba040718dc77cc/family1 2023-03-22 17:55:11,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__2gemrbb467iuukooergj6gu43qlej74e7h485g76hkb23jt984m96fqe032l7diu/family1/b444f776d6104f5ca4ac52ed5c889005 into 62875c1cb9dc4a5947ba040718dc77cc/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/fbae551d2aa74fa5b11c381201f0acb6_SeqId_34_) 2023-03-22 17:55:11,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__2gemrbb467iuukooergj6gu43qlej74e7h485g76hkb23jt984m96fqe032l7diu/family1/b444f776d6104f5ca4ac52ed5c889005 2023-03-22 17:55:11,335 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:11,336 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:11,338 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023032252b2f804138c4367a439e3185ea29b6b 2023-03-22 17:55:11,339 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303229caba84cc5354b50aeefc5d7d2ebf012 2023-03-22 17:55:11,340 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230322c37b9ce97c9543e99767f6140e81ca63 2023-03-22 17:55:11,341 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230322c668ff7d8a7947888d04e2a3eb09c621 2023-03-22 17:55:11,341 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:11,341 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230322' 2023-03-22 17:55:11,342 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:11,437 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family2/f6c0591bd74c425086c7b416968f1307 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/f6c0591bd74c425086c7b416968f1307 2023-03-22 17:55:11,441 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-22 17:55:11,441 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 62875c1cb9dc4a5947ba040718dc77cc/family2 of 62875c1cb9dc4a5947ba040718dc77cc into f6c0591bd74c425086c7b416968f1307(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:11,442 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:11,442 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., storeName=62875c1cb9dc4a5947ba040718dc77cc/family2, priority=12, startTime=1679507710925; duration=0sec 2023-03-22 17:55:11,442 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-22 17:55:11,442 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-22 17:55:11,444 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-22 17:55:11,444 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1912): 72d334bfaccf92d12e3cc29b15536ea4/family1 is initiating minor compaction (all files) 2023-03-22 17:55:11,444 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 72d334bfaccf92d12e3cc29b15536ea4/family1 in testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:11,444 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp, totalSize=21.6 K 2023-03-22 17:55:11,445 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693635 2023-03-22 17:55:11,445 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:11,446 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:11,446 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:11,456 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] throttle.PressureAwareThroughputController(145): 72d334bfaccf92d12e3cc29b15536ea4#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:11,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af] to archive 2023-03-22 17:55:11,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:11,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-ce83bd13b75d47efa0aa8a3cb56f39b7 2023-03-22 17:55:11,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-888a14edb062474f8cd6e938b7b7967f 2023-03-22 17:55:11,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-26e10695602d460f9791ea5549d7aae0 2023-03-22 17:55:11,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family2/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-8a3bbbff9b1e409980247caaaf5d88af 2023-03-22 17:55:12,081 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032272f2998283d64ea29e2de74b93fb983e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032272f2998283d64ea29e2de74b93fb983e 2023-03-22 17:55:12,082 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:12,087 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303228fe4a37fc5e247d2bf6bcada750ce6b4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303228fe4a37fc5e247d2bf6bcada750ce6b4 2023-03-22 17:55:12,089 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:12,110 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/109166f9a3b84933bcc825d2fd98d5e1 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-22 17:55:12,111 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=32 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/109166f9a3b84933bcc825d2fd98d5e1}] 2023-03-22 17:55:12,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/109166f9a3b84933bcc825d2fd98d5e1 for inclusion in 546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:12,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-22 17:55:12,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last=1 2023-03-22 17:55:12,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:12,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322/family1/109166f9a3b84933bcc825d2fd98d5e1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__h0aef115b4djeet50a05r5l63sq9tpp4dsp4l3075i2hm0f44fj6p1kq5v2beq3l/family1/109166f9a3b84933bcc825d2fd98d5e1 2023-03-22 17:55:12,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__h0aef115b4djeet50a05r5l63sq9tpp4dsp4l3075i2hm0f44fj6p1kq5v2beq3l/family1/109166f9a3b84933bcc825d2fd98d5e1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_ 2023-03-22 17:55:12,121 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__h0aef115b4djeet50a05r5l63sq9tpp4dsp4l3075i2hm0f44fj6p1kq5v2beq3l/family1/109166f9a3b84933bcc825d2fd98d5e1 into 546a55e513840caf9aef078505d378c5/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_ - updating store file list. 2023-03-22 17:55:12,123 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/0eccde7cf80342e89a3fbb516acbc0f6 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-22 17:55:12,124 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/0eccde7cf80342e89a3fbb516acbc0f6}] 2023-03-22 17:55:12,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_ into 546a55e513840caf9aef078505d378c5/family1 2023-03-22 17:55:12,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__h0aef115b4djeet50a05r5l63sq9tpp4dsp4l3075i2hm0f44fj6p1kq5v2beq3l/family1/109166f9a3b84933bcc825d2fd98d5e1 into 546a55e513840caf9aef078505d378c5/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_) 2023-03-22 17:55:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__h0aef115b4djeet50a05r5l63sq9tpp4dsp4l3075i2hm0f44fj6p1kq5v2beq3l/family1/109166f9a3b84933bcc825d2fd98d5e1 2023-03-22 17:55:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:12,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/0eccde7cf80342e89a3fbb516acbc0f6 for inclusion in 72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:12,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-22 17:55:12,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-22 17:55:12,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:12,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-22 17:55:12,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(1912): 546a55e513840caf9aef078505d378c5/family1 is initiating minor compaction (all files) 2023-03-22 17:55:12,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ce5d495; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-22 17:55:12,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322/family1/0eccde7cf80342e89a3fbb516acbc0f6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__d1j743c8pj6bfdsp14f4mrq5cq2n2cgfgknhhl5hm14mimp8j2td77sh73pjb1o9/family1/0eccde7cf80342e89a3fbb516acbc0f6 2023-03-22 17:55:12,133 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:12,134 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:12,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__d1j743c8pj6bfdsp14f4mrq5cq2n2cgfgknhhl5hm14mimp8j2td77sh73pjb1o9/family1/0eccde7cf80342e89a3fbb516acbc0f6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/ba53f4d139784b5ca315984b3e71830c_SeqId_34_ 2023-03-22 17:55:12,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__d1j743c8pj6bfdsp14f4mrq5cq2n2cgfgknhhl5hm14mimp8j2td77sh73pjb1o9/family1/0eccde7cf80342e89a3fbb516acbc0f6 into 72d334bfaccf92d12e3cc29b15536ea4/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/ba53f4d139784b5ca315984b3e71830c_SeqId_34_ - updating store file list. 2023-03-22 17:55:12,135 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023032211100e9f1f2049669a44184f02b730b9 2023-03-22 17:55:12,136 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322bdb3aa3eee9f4a929ce96af2dcd27cfc 2023-03-22 17:55:12,137 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322d7271e1f266242f6aaabee511661fc36 2023-03-22 17:55:12,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/ba53f4d139784b5ca315984b3e71830c_SeqId_34_ into 72d334bfaccf92d12e3cc29b15536ea4/family1 2023-03-22 17:55:12,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__d1j743c8pj6bfdsp14f4mrq5cq2n2cgfgknhhl5hm14mimp8j2td77sh73pjb1o9/family1/0eccde7cf80342e89a3fbb516acbc0f6 into 72d334bfaccf92d12e3cc29b15536ea4/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/ba53f4d139784b5ca315984b3e71830c_SeqId_34_) 2023-03-22 17:55:12,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testCompactionWithHFileLink__d1j743c8pj6bfdsp14f4mrq5cq2n2cgfgknhhl5hm14mimp8j2td77sh73pjb1o9/family1/0eccde7cf80342e89a3fbb516acbc0f6 2023-03-22 17:55:12,138 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230322df5d777f9be2491da60f047ca5b35716 2023-03-22 17:55:12,139 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:12,139 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230322' 2023-03-22 17:55:12,139 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:12,140 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:12,141 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:12,142 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303229fb67cef67534c9d862b741a77b7b7b0 2023-03-22 17:55:12,143 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322b0fec22eea6b467e9d63d0ceddcd7738 2023-03-22 17:55:12,144 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322e233498c3f464485a9d7dc2b66fad303 2023-03-22 17:55:12,145 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230322e2cab9942310431d86a5f8bf1542a0c2 2023-03-22 17:55:12,145 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-22 17:55:12,145 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230322' 2023-03-22 17:55:12,145 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230322 for table='testCompactionWithHFileLink' and column='family1' 2023-03-22 17:55:12,145 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-22 17:55:12,148 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:12,151 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:12,153 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:12,154 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:12,159 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:12,160 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:12,178 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=283 (was 251) - Thread LEAK? -, OpenFileDescriptor=737 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 325), ProcessCount=169 (was 169), AvailableMemoryMB=5876 (was 6015) 2023-03-22 17:55:12,192 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=737, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=169, AvailableMemoryMB=5876 2023-03-22 17:55:12,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-22 17:55:12,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-22 17:55:12,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-22 17:55:12,204 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-22 17:55:12,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-03-22 17:55:12,220 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/.tmp/family1/208310bfeaed4282ad64e8fdb6124028 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/208310bfeaed4282ad64e8fdb6124028 2023-03-22 17:55:12,225 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 62875c1cb9dc4a5947ba040718dc77cc/family1 of 62875c1cb9dc4a5947ba040718dc77cc into 208310bfeaed4282ad64e8fdb6124028(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:12,225 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:12,225 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc., storeName=62875c1cb9dc4a5947ba040718dc77cc/family1, priority=12, startTime=1679507710924; duration=1sec 2023-03-22 17:55:12,225 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-22 17:55:12,225 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 546a55e513840caf9aef078505d378c5/family1 in testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:12,225 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp, totalSize=28.9 K 2023-03-22 17:55:12,226 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693633 2023-03-22 17:55:12,227 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:12,227 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:12,228 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:12,228 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 123feb08bf9e421fbfab967c8d7042b9_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1679507693633 2023-03-22 17:55:12,246 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 546a55e513840caf9aef078505d378c5#family1#compaction#116 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:12,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-22 17:55:12,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-22 17:55:12,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-22 17:55:12,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:55:12,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-22 17:55:12,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:55:12,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:12,309 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:12,309 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:12,309 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de empty. 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870 empty. 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd empty. 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:12,310 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:12,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-22 17:55:12,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6] to archive 2023-03-22 17:55:12,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:12,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-15bc2d88d42f448eb388e02defef96c3 2023-03-22 17:55:12,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-f64a555940ff423a8cf421e88ef3f4bc 2023-03-22 17:55:12,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-2c09b33de1be4a24b2edac559979c864 2023-03-22 17:55:12,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/family1/testCompactionWithHFileLink=62875c1cb9dc4a5947ba040718dc77cc-c9f78d8dbbc24f88aadc357960d9f8b6 2023-03-22 17:55:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:12,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:12,672 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family1/ee88f235e1a94ff681b9081a1c1b1282 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/ee88f235e1a94ff681b9081a1c1b1282 2023-03-22 17:55:12,676 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 72d334bfaccf92d12e3cc29b15536ea4/family1 of 72d334bfaccf92d12e3cc29b15536ea4 into ee88f235e1a94ff681b9081a1c1b1282(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:12,676 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:12,676 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., storeName=72d334bfaccf92d12e3cc29b15536ea4/family1, priority=12, startTime=1679507711037; duration=1sec 2023-03-22 17:55:12,676 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-22 17:55:12,676 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-22 17:55:12,678 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-22 17:55:12,678 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1912): 72d334bfaccf92d12e3cc29b15536ea4/family2 is initiating minor compaction (all files) 2023-03-22 17:55:12,678 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 72d334bfaccf92d12e3cc29b15536ea4/family2 in testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:12,678 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp, totalSize=20.4 K 2023-03-22 17:55:12,679 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693635 2023-03-22 17:55:12,679 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:12,680 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:12,680 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:12,690 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] throttle.PressureAwareThroughputController(145): 72d334bfaccf92d12e3cc29b15536ea4#family2#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:12,716 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-22 17:55:12,718 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6bf4ad76645cab3c5938606f0a9ae870, NAME => 'ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:12,718 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => dfab92a478307e4a572bc8d39b8084fd, NAME => 'ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:12,718 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea758f8595ac567ffe84ee13d88907de, NAME => 'ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:12,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4] to archive 2023-03-22 17:55:12,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:12,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-3f209649afb54ddfb84368a7279a5eb1 2023-03-22 17:55:12,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-945d21b5cd9f4b7fbcd693c8d6a4da24 2023-03-22 17:55:12,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9a5534a5a27844ca96484af563e83007 2023-03-22 17:55:12,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family1/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-36a50fb4e4e44cb39f99725902c9f2b4 2023-03-22 17:55:12,747 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:55:12,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:13,123 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,123 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 6bf4ad76645cab3c5938606f0a9ae870, disabling compactions & flushes 2023-03-22 17:55:13,123 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,123 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,123 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. after waiting 0 ms 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,124 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing ea758f8595ac567ffe84ee13d88907de, disabling compactions & flushes 2023-03-22 17:55:13,124 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. after waiting 0 ms 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,124 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing dfab92a478307e4a572bc8d39b8084fd, disabling compactions & flushes 2023-03-22 17:55:13,124 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. after waiting 0 ms 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,124 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,124 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:13,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:55:13,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507713127"}]},"ts":"1679507713127"} 2023-03-22 17:55:13,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507713127"}]},"ts":"1679507713127"} 2023-03-22 17:55:13,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679507713127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507713127"}]},"ts":"1679507713127"} 2023-03-22 17:55:13,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-22 17:55:13,129 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:55:13,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507713129"}]},"ts":"1679507713129"} 2023-03-22 17:55:13,130 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-22 17:55:13,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ea758f8595ac567ffe84ee13d88907de, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=dfab92a478307e4a572bc8d39b8084fd, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6bf4ad76645cab3c5938606f0a9ae870, ASSIGN}] 2023-03-22 17:55:13,135 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ea758f8595ac567ffe84ee13d88907de, ASSIGN 2023-03-22 17:55:13,135 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=dfab92a478307e4a572bc8d39b8084fd, ASSIGN 2023-03-22 17:55:13,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6bf4ad76645cab3c5938606f0a9ae870, ASSIGN 2023-03-22 17:55:13,135 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ea758f8595ac567ffe84ee13d88907de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:13,135 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6bf4ad76645cab3c5938606f0a9ae870, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:13,135 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=dfab92a478307e4a572bc8d39b8084fd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:13,288 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6bf4ad76645cab3c5938606f0a9ae870, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,288 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=dfab92a478307e4a572bc8d39b8084fd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,288 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ea758f8595ac567ffe84ee13d88907de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507713288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507713288"}]},"ts":"1679507713288"} 2023-03-22 17:55:13,288 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507713288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507713288"}]},"ts":"1679507713288"} 2023-03-22 17:55:13,288 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679507713288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507713288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507713288"}]},"ts":"1679507713288"} 2023-03-22 17:55:13,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 6bf4ad76645cab3c5938606f0a9ae870, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:13,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure ea758f8595ac567ffe84ee13d88907de, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:13,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure dfab92a478307e4a572bc8d39b8084fd, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:13,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dfab92a478307e4a572bc8d39b8084fd, NAME => 'ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.', STARTKEY => '1', ENDKEY => '2'} 2023-03-22 17:55:13,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,444 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,446 DEBUG [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1 2023-03-22 17:55:13,446 DEBUG [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1 2023-03-22 17:55:13,446 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfab92a478307e4a572bc8d39b8084fd columnFamilyName family1 2023-03-22 17:55:13,447 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] regionserver.HStore(310): Store=dfab92a478307e4a572bc8d39b8084fd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,447 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,448 DEBUG [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2 2023-03-22 17:55:13,448 DEBUG [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2 2023-03-22 17:55:13,449 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfab92a478307e4a572bc8d39b8084fd columnFamilyName family2 2023-03-22 17:55:13,449 INFO [StoreOpener-dfab92a478307e4a572bc8d39b8084fd-1] regionserver.HStore(310): Store=dfab92a478307e4a572bc8d39b8084fd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:13,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:13,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:13,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dfab92a478307e4a572bc8d39b8084fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71712981, jitterRate=0.06860668957233429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:13,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:13,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd., pid=111, masterSystemTime=1679507713441 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:13,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bf4ad76645cab3c5938606f0a9ae870, NAME => 'ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.', STARTKEY => '2', ENDKEY => ''} 2023-03-22 17:55:13,456 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=dfab92a478307e4a572bc8d39b8084fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,456 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679507713456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507713456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507713456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507713456"}]},"ts":"1679507713456"} 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,457 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,458 DEBUG [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1 2023-03-22 17:55:13,458 DEBUG [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1 2023-03-22 17:55:13,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-03-22 17:55:13,459 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bf4ad76645cab3c5938606f0a9ae870 columnFamilyName family1 2023-03-22 17:55:13,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure dfab92a478307e4a572bc8d39b8084fd, server=jenkins-hbase4.apache.org,46619,1679507617635 in 167 msec 2023-03-22 17:55:13,459 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] regionserver.HStore(310): Store=6bf4ad76645cab3c5938606f0a9ae870/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=dfab92a478307e4a572bc8d39b8084fd, ASSIGN in 326 msec 2023-03-22 17:55:13,460 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,461 DEBUG [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2 2023-03-22 17:55:13,461 DEBUG [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2 2023-03-22 17:55:13,461 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bf4ad76645cab3c5938606f0a9ae870 columnFamilyName family2 2023-03-22 17:55:13,462 INFO [StoreOpener-6bf4ad76645cab3c5938606f0a9ae870-1] regionserver.HStore(310): Store=6bf4ad76645cab3c5938606f0a9ae870/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,463 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family1/f97ee0a53bac478b81cc6944acd9b5a9 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/f97ee0a53bac478b81cc6944acd9b5a9 2023-03-22 17:55:13,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:13,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:13,467 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 546a55e513840caf9aef078505d378c5/family1 of 546a55e513840caf9aef078505d378c5 into f97ee0a53bac478b81cc6944acd9b5a9(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:13,467 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:13,467 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1679507712129; duration=1sec 2023-03-22 17:55:13,467 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-22 17:55:13,467 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-22 17:55:13,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:13,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bf4ad76645cab3c5938606f0a9ae870; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65757046, jitterRate=-0.02014365792274475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:13,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:13,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870., pid=109, masterSystemTime=1679507713441 2023-03-22 17:55:13,469 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-22 17:55:13,469 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1912): 546a55e513840caf9aef078505d378c5/family2 is initiating minor compaction (all files) 2023-03-22 17:55:13,469 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 546a55e513840caf9aef078505d378c5/family2 in testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:13,470 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp, totalSize=20.4 K 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:13,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea758f8595ac567ffe84ee13d88907de, NAME => 'ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.', STARTKEY => '', ENDKEY => '1'} 2023-03-22 17:55:13,470 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6bf4ad76645cab3c5938606f0a9ae870, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,470 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507713470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507713470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507713470"}]},"ts":"1679507713470"} 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:13,470 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507693633 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,471 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507694698 2023-03-22 17:55:13,471 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,472 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507695877 2023-03-22 17:55:13,472 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507697307 2023-03-22 17:55:13,472 DEBUG [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1 2023-03-22 17:55:13,473 DEBUG [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1 2023-03-22 17:55:13,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-03-22 17:55:13,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 6bf4ad76645cab3c5938606f0a9ae870, server=jenkins-hbase4.apache.org,46619,1679507617635 in 182 msec 2023-03-22 17:55:13,473 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea758f8595ac567ffe84ee13d88907de columnFamilyName family1 2023-03-22 17:55:13,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6bf4ad76645cab3c5938606f0a9ae870, ASSIGN in 340 msec 2023-03-22 17:55:13,474 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] regionserver.HStore(310): Store=ea758f8595ac567ffe84ee13d88907de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,474 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,475 DEBUG [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2 2023-03-22 17:55:13,475 DEBUG [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2 2023-03-22 17:55:13,475 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea758f8595ac567ffe84ee13d88907de columnFamilyName family2 2023-03-22 17:55:13,476 INFO [StoreOpener-ea758f8595ac567ffe84ee13d88907de-1] regionserver.HStore(310): Store=ea758f8595ac567ffe84ee13d88907de/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:13,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:13,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:13,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:13,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea758f8595ac567ffe84ee13d88907de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72586979, jitterRate=0.08163027465343475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:13,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:13,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de., pid=110, masterSystemTime=1679507713441 2023-03-22 17:55:13,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:13,483 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ea758f8595ac567ffe84ee13d88907de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:13,483 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679507713483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507713483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507713483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507713483"}]},"ts":"1679507713483"} 2023-03-22 17:55:13,484 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): 546a55e513840caf9aef078505d378c5#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:13,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-03-22 17:55:13,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure ea758f8595ac567ffe84ee13d88907de, server=jenkins-hbase4.apache.org,46619,1679507617635 in 194 msec 2023-03-22 17:55:13,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-03-22 17:55:13,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ea758f8595ac567ffe84ee13d88907de, ASSIGN in 352 msec 2023-03-22 17:55:13,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:55:13,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507713487"}]},"ts":"1679507713487"} 2023-03-22 17:55:13,488 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-22 17:55:13,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:55:13,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1850 sec 2023-03-22 17:55:13,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_] to archive 2023-03-22 17:55:13,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:13,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-734ac5af4ab5473ba3375d7190893c23 2023-03-22 17:55:13,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-5580763adde149abb98f8a5f6922048f 2023-03-22 17:55:13,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-f71ce6ceefee44658c58695ceb150609 2023-03-22 17:55:13,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-ac28f88f5cf54e49a8d0adf7189bb3e3 2023-03-22 17:55:13,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family1/123feb08bf9e421fbfab967c8d7042b9_SeqId_34_ 2023-03-22 17:55:13,905 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/.tmp/family2/0cf7f989c1bf4690bae0ab2845e64f3b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/0cf7f989c1bf4690bae0ab2845e64f3b 2023-03-22 17:55:13,909 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 72d334bfaccf92d12e3cc29b15536ea4/family2 of 72d334bfaccf92d12e3cc29b15536ea4 into 0cf7f989c1bf4690bae0ab2845e64f3b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:13,909 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:13,909 INFO [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4., storeName=72d334bfaccf92d12e3cc29b15536ea4/family2, priority=12, startTime=1679507711037; duration=1sec 2023-03-22 17:55:13,909 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-22 17:55:13,909 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-22 17:55:13,910 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-22 17:55:13,910 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-22 17:55:13,910 DEBUG [RS:0;jenkins-hbase4:46619-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. because compaction request was cancelled 2023-03-22 17:55:13,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627] to archive 2023-03-22 17:55:13,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:13,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-60d5ecdb925749e8abf85d53ae0c25c6 2023-03-22 17:55:13,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-9d687bab2dc945cfbbd34098ca67b984 2023-03-22 17:55:13,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-594a280063e3423e98a1350bfbb08a49 2023-03-22 17:55:13,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/family2/testCompactionWithHFileLink=72d334bfaccf92d12e3cc29b15536ea4-bfdb74b39e4c4d819063a11caba0d627 2023-03-22 17:55:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-22 17:55:14,412 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-22 17:55:14,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:14,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:14,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:14,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:14,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-22 17:55:14,422 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-22 17:55:14,422 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:14,422 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-22 17:55:14,422 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-22 17:55:14,423 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:14,423 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:14,424 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:14,425 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:14,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:14,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:14,425 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:14,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:14,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-22 17:55:14,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-22 17:55:14,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-22 17:55:14,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:14,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-22 17:55:14,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:14,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. started... 2023-03-22 17:55:14,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:14,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:14,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:14,428 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dfab92a478307e4a572bc8d39b8084fd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:14,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:14,428 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. started... 2023-03-22 17:55:14,428 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. started... 2023-03-22 17:55:14,428 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6bf4ad76645cab3c5938606f0a9ae870 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:14,428 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ea758f8595ac567ffe84ee13d88907de 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:14,701 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/.tmp/family2/a6f1ac813bb749e79b8d97713250d9d8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/a6f1ac813bb749e79b8d97713250d9d8 2023-03-22 17:55:14,704 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 546a55e513840caf9aef078505d378c5/family2 of 546a55e513840caf9aef078505d378c5 into a6f1ac813bb749e79b8d97713250d9d8(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:14,705 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:14,705 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5., storeName=546a55e513840caf9aef078505d378c5/family2, priority=12, startTime=1679507711089; duration=1sec 2023-03-22 17:55:14,705 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:14,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1] to archive 2023-03-22 17:55:14,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:14,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-655a1a41bbb144f580d09b040711178e 2023-03-22 17:55:14,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-93588c990e4d48b3a4b969e7a3b59fa5 2023-03-22 17:55:14,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-cda58a834ef34e45929770ebdac6ede6 2023-03-22 17:55:14,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/family2/testCompactionWithHFileLink=546a55e513840caf9aef078505d378c5-6ed2c53c9fef410fa232b1f10375f9f1 2023-03-22 17:55:14,839 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303227b66e796851347dea0c25e80cefe8687 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303227b66e796851347dea0c25e80cefe8687 2023-03-22 17:55:14,839 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322a5ef305d2d8c4bc4a093d9da0045f19b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230322a5ef305d2d8c4bc4a093d9da0045f19b 2023-03-22 17:55:14,840 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322000b51e7dbee4ac5bdf3b3e3142cbd96 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230322000b51e7dbee4ac5bdf3b3e3142cbd96 2023-03-22 17:55:14,848 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/e55a8d0b4d8d4b2087cccd3f941dd494 2023-03-22 17:55:15,250 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/593af11b87f34f019e3c7a3f2570bfa7 2023-03-22 17:55:15,250 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/a55f2b942f3b428d8acbd864522545a0 2023-03-22 17:55:15,262 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303223d1ac5a6fdc04c929064d854298fb300 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303223d1ac5a6fdc04c929064d854298fb300 2023-03-22 17:55:15,276 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/427255b87f2b4f4da81c2f68ee25f8c2 2023-03-22 17:55:15,277 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303220ac4377d35824be392d3b5bce5b4697c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303220ac4377d35824be392d3b5bce5b4697c 2023-03-22 17:55:15,279 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/e55a8d0b4d8d4b2087cccd3f941dd494 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494 2023-03-22 17:55:15,281 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/a44d8d41caf946848716d732b965877a 2023-03-22 17:55:15,283 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:55:15,283 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/427255b87f2b4f4da81c2f68ee25f8c2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2 2023-03-22 17:55:15,285 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/a55f2b942f3b428d8acbd864522545a0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0 2023-03-22 17:55:15,286 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:15,287 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for dfab92a478307e4a572bc8d39b8084fd in 859ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:15,287 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-22 17:55:15,288 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:15,288 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:15,288 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:55:15,289 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/a44d8d41caf946848716d732b965877a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a 2023-03-22 17:55:15,291 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:15,292 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ea758f8595ac567ffe84ee13d88907de in 864ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:15,293 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:15,293 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:15,673 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303224a57f0eae96c405fa9d5218ab707fc07 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303224a57f0eae96c405fa9d5218ab707fc07 2023-03-22 17:55:16,078 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/e0c3f43fd2024106b3203ab03088b4ca 2023-03-22 17:55:16,082 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/593af11b87f34f019e3c7a3f2570bfa7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7 2023-03-22 17:55:16,085 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7, entries=4, sequenceid=5, filesize=5.4 K 2023-03-22 17:55:16,086 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/e0c3f43fd2024106b3203ab03088b4ca as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca 2023-03-22 17:55:16,089 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:16,089 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6bf4ad76645cab3c5938606f0a9ae870 in 1661ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:16,089 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:16,089 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-22 17:55:16,090 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-22 17:55:16,091 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:16,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:16,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-22 17:55:16,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b0a9820[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:16,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-22 17:55:16,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,094 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,094 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-22 17:55:16,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-22 17:55:16,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:16,095 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,095 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:16,096 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,096 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-22 17:55:16,096 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:16,096 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:16,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-22 17:55:16,098 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-22 17:55:16,098 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:16,098 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:16,098 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-22 17:55:16,098 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:16,100 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,100 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:16,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,100 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:16,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:16,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:16,104 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:16,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-22 17:55:16,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:16,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:16,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:16,104 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,204 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:16,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:16,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:16,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:16,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:16,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-22 17:55:16,210 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-22 17:55:16,210 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:16,211 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-22 17:55:16,211 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-22 17:55:16,211 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,211 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:16,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,212 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:16,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:16,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:16,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:16,212 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-22 17:55:16,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-22 17:55:16,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-22 17:55:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-22 17:55:16,213 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:16,214 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:16,214 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:16,214 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. started... 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. started... 2023-03-22 17:55:16,214 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. started... 2023-03-22 17:55:16,214 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dfab92a478307e4a572bc8d39b8084fd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:16,214 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6bf4ad76645cab3c5938606f0a9ae870 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:16,214 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ea758f8595ac567ffe84ee13d88907de 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:16,231 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032208b7bfc2cd78436e91e3780d6e3833d3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032208b7bfc2cd78436e91e3780d6e3833d3 2023-03-22 17:55:16,235 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/e29a3822aa76458bb8ac36f0227145dc 2023-03-22 17:55:16,631 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322e89a5adb8c5947988858c8dffe26f84a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230322e89a5adb8c5947988858c8dffe26f84a 2023-03-22 17:55:16,632 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303220cc0cc3addbb47f7996805b9a65c2482 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303220cc0cc3addbb47f7996805b9a65c2482 2023-03-22 17:55:16,645 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322b0890062127848a9b28071fed50a6c90 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230322b0890062127848a9b28071fed50a6c90 2023-03-22 17:55:17,037 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/8b3f09712eb3425d98e47fba395b020e 2023-03-22 17:55:17,037 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/160d74c5598a48c09188d8b89b480b65 2023-03-22 17:55:17,050 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/05c914b98af54ad5b50b5b20aba298a7 2023-03-22 17:55:17,053 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/e29a3822aa76458bb8ac36f0227145dc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc 2023-03-22 17:55:17,056 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:55:17,057 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/05c914b98af54ad5b50b5b20aba298a7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7 2023-03-22 17:55:17,059 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:17,060 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for dfab92a478307e4a572bc8d39b8084fd in 846ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:17,060 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:17,060 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:17,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303228b3f22f03e8c4f2daa5b636731582f47 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303228b3f22f03e8c4f2daa5b636731582f47 2023-03-22 17:55:17,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032214e9b897d43f4366a533816c2718ae63 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023032214e9b897d43f4366a533816c2718ae63 2023-03-22 17:55:17,869 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/ed6636839d6d4af0988f4256801befb7 2023-03-22 17:55:17,869 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/100297d451eb4752bf76afab43b873f2 2023-03-22 17:55:17,872 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/160d74c5598a48c09188d8b89b480b65 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65 2023-03-22 17:55:17,873 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/8b3f09712eb3425d98e47fba395b020e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e 2023-03-22 17:55:17,875 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:55:17,876 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e, entries=4, sequenceid=9, filesize=5.4 K 2023-03-22 17:55:17,876 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/ed6636839d6d4af0988f4256801befb7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7 2023-03-22 17:55:17,876 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/100297d451eb4752bf76afab43b873f2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2 2023-03-22 17:55:17,879 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:17,879 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:17,880 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6bf4ad76645cab3c5938606f0a9ae870 in 1666ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:17,880 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ea758f8595ac567ffe84ee13d88907de in 1666ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:17,880 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:17,880 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:17,880 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:17,880 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-22 17:55:17,880 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-22 17:55:17,883 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,883 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:17,883 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,883 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:17,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-22 17:55:17,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b850f82[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:17,885 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-22 17:55:17,885 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,886 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,886 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-22 17:55:17,886 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-22 17:55:17,886 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:17,886 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,886 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-22 17:55:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:17,892 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-22 17:55:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-22 17:55:17,894 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-22 17:55:17,894 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:17,894 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:17,894 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-22 17:55:17,894 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:17,896 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,896 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:17,896 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:17,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:17,896 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,897 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:17,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:17,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-22 17:55:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:17,899 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:17,899 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,900 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:17,900 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:17,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-22 17:55:17,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:17,901 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:17,901 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:18,001 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:18,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:18,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:18,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:18,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:18,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:18,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:18,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-22 17:55:18,007 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-22 17:55:18,007 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:18,007 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-22 17:55:18,007 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-22 17:55:18,007 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:18,008 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:18,009 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:18,009 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:18,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:18,010 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:18,010 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:18,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:18,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:18,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:18,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:18,010 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-22 17:55:18,011 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-22 17:55:18,011 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-22 17:55:18,011 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-22 17:55:18,011 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:18,011 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. started... 2023-03-22 17:55:18,011 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:18,011 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. started... 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:18,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. started... 2023-03-22 17:55:18,011 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6bf4ad76645cab3c5938606f0a9ae870 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:18,011 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dfab92a478307e4a572bc8d39b8084fd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:18,011 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ea758f8595ac567ffe84ee13d88907de 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:18,038 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303223daa72eba4654f229252bc80669a2170 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303223daa72eba4654f229252bc80669a2170 2023-03-22 17:55:18,045 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303225aa79829fafb4300b0180b18093044fd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303225aa79829fafb4300b0180b18093044fd 2023-03-22 17:55:18,047 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/baeb9f006a5f4cbeadf92ccf36ca00b8 2023-03-22 17:55:18,434 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032217cc7fa6a4364af1955a334a04f0e201 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023032217cc7fa6a4364af1955a334a04f0e201 2023-03-22 17:55:18,457 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/b61df3332404477ebc5860eff3e483e6 2023-03-22 17:55:18,470 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303223fb0790bbfb8482398b4fab1ffa1f861 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303223fb0790bbfb8482398b4fab1ffa1f861 2023-03-22 17:55:18,471 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303227a79360458034664b8ad0e8f441fa2e9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303227a79360458034664b8ad0e8f441fa2e9 2023-03-22 17:55:18,474 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/275dc5e4c1194166b99427484acdff2b 2023-03-22 17:55:18,477 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/baeb9f006a5f4cbeadf92ccf36ca00b8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8 2023-03-22 17:55:18,480 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:55:18,480 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/275dc5e4c1194166b99427484acdff2b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b 2023-03-22 17:55:18,483 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:18,484 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ea758f8595ac567ffe84ee13d88907de in 473ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:18,484 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:18,485 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:18,485 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:18,838 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/91dabacc924347878d22ab045334fb6f 2023-03-22 17:55:18,875 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/1fe93af778f94227aeffc3f0240762d0 2023-03-22 17:55:18,879 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/b61df3332404477ebc5860eff3e483e6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6 2023-03-22 17:55:18,882 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:55:18,882 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/1fe93af778f94227aeffc3f0240762d0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0 2023-03-22 17:55:18,886 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:18,887 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for dfab92a478307e4a572bc8d39b8084fd in 876ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:18,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:18,887 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:18,887 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:18,945 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:55:19,252 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322ede3786a979f45c7bb3d8f5172aa46d4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230322ede3786a979f45c7bb3d8f5172aa46d4 2023-03-22 17:55:19,656 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/bf5a7c0b28d04e73800c18ed2724e98a 2023-03-22 17:55:19,660 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/91dabacc924347878d22ab045334fb6f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f 2023-03-22 17:55:19,663 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f, entries=4, sequenceid=13, filesize=5.4 K 2023-03-22 17:55:19,663 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/bf5a7c0b28d04e73800c18ed2724e98a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a 2023-03-22 17:55:19,666 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:19,667 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6bf4ad76645cab3c5938606f0a9ae870 in 1656ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:19,667 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:19,667 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:19,667 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:19,667 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:19,667 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,667 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-22 17:55:19,667 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-22 17:55:19,669 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,669 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:19,670 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,670 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:19,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-22 17:55:19,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24dc86bc[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:19,671 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-22 17:55:19,671 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,672 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,672 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-22 17:55:19,672 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-22 17:55:19,672 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:19,672 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,672 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:19,673 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-22 17:55:19,673 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,673 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:19,673 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-22 17:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-22 17:55:19,675 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-22 17:55:19,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:19,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:19,675 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-22 17:55:19,675 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:19,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:19,678 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:19,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:19,678 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,679 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,681 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,681 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:19,681 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:19,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:19,682 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:19,681 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:19,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:19,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-22 17:55:19,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:19,681 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:19,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:19,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:19,682 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:19,782 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:19,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:19,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:19,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:19,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:19,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:19,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:19,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-22 17:55:19,788 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-22 17:55:19,788 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:19,788 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-22 17:55:19,788 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-22 17:55:19,789 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,789 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:19,790 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,790 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:19,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:19,790 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:19,790 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:19,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:19,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-22 17:55:19,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-22 17:55:19,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-22 17:55:19,791 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-22 17:55:19,791 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:19,791 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-22 17:55:19,791 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:19,792 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. started... 2023-03-22 17:55:19,792 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:19,792 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:19,792 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:19,792 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dfab92a478307e4a572bc8d39b8084fd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:19,792 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:19,792 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. started... 2023-03-22 17:55:19,792 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. started... 2023-03-22 17:55:19,792 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6bf4ad76645cab3c5938606f0a9ae870 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:19,792 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ea758f8595ac567ffe84ee13d88907de 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:20,203 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322fee129acccc9497fa0636815701483a6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230322fee129acccc9497fa0636815701483a6 2023-03-22 17:55:20,203 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322d803c71e60bc4db38f11efb20b2a5688 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230322d803c71e60bc4db38f11efb20b2a5688 2023-03-22 17:55:20,203 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032265701f806ab64abc9c187ff28d693ce6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023032265701f806ab64abc9c187ff28d693ce6 2023-03-22 17:55:20,609 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a 2023-03-22 17:55:20,609 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/5391924924524aca95ba4ba52f69bb04 2023-03-22 17:55:20,609 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/71c29b3615e1430da8994765cff695ac 2023-03-22 17:55:20,622 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303228507cea963b14754b14dd394bcebdda9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303228507cea963b14754b14dd394bcebdda9 2023-03-22 17:55:20,626 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/caec5778d0f748458885ba2c902ff0ea 2023-03-22 17:55:20,629 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/5391924924524aca95ba4ba52f69bb04 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04 2023-03-22 17:55:20,632 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:55:20,632 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/caec5778d0f748458885ba2c902ff0ea as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea 2023-03-22 17:55:20,635 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:20,635 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ea758f8595ac567ffe84ee13d88907de in 843ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:20,635 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:20,635 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:20,635 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:21,023 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303221e0de228a1ae42ccab7b13b2877237a7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303221e0de228a1ae42ccab7b13b2877237a7 2023-03-22 17:55:21,024 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303223bd33652065645afac860fe55b3e84f3 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303223bd33652065645afac860fe55b3e84f3 2023-03-22 17:55:21,428 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f 2023-03-22 17:55:21,428 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/fa29443665424c3abba33b32ad5168d6 2023-03-22 17:55:21,432 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a 2023-03-22 17:55:21,432 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/71c29b3615e1430da8994765cff695ac as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac 2023-03-22 17:55:21,436 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:55:21,436 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac, entries=4, sequenceid=17, filesize=5.4 K 2023-03-22 17:55:21,436 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f 2023-03-22 17:55:21,437 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/fa29443665424c3abba33b32ad5168d6 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6 2023-03-22 17:55:21,440 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:21,440 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:21,441 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for dfab92a478307e4a572bc8d39b8084fd in 1648ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:21,441 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:21,441 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:21,441 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6bf4ad76645cab3c5938606f0a9ae870 in 1649ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:21,441 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:21,441 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-22 17:55:21,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-22 17:55:21,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,443 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:21,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-22 17:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61bf5af2[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:21,444 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-22 17:55:21,444 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,447 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,447 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-22 17:55:21,447 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-22 17:55:21,447 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:21,447 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,447 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-22 17:55:21,449 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-22 17:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:21,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-22 17:55:21,452 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-22 17:55:21,452 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:21,452 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:21,452 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-22 17:55:21,452 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:21,454 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,454 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,454 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:21,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:21,454 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,455 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:21,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:21,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,459 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:21,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-22 17:55:21,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-22 17:55:21,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:21,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:21,459 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:21,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:21,560 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:21,568 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:21,573 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:21,580 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:21,581 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:21,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:21,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:21,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-22 17:55:21,609 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-22 17:55:21,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:21,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-22 17:55:21,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-22 17:55:21,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,609 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:21,610 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,610 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:21,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:21,611 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:21,611 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:21,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-22 17:55:21,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-22 17:55:21,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-22 17:55:21,612 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-22 17:55:21,612 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:21,612 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. started... 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:21,612 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dfab92a478307e4a572bc8d39b8084fd 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. started... 2023-03-22 17:55:21,612 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:21,612 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:21,612 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. started... 2023-03-22 17:55:21,612 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6bf4ad76645cab3c5938606f0a9ae870 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:21,613 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ea758f8595ac567ffe84ee13d88907de 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:21,633 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/0790cf18b2ac456290bdef41331f4605 2023-03-22 17:55:21,636 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0790cf18b2ac456290bdef41331f4605 2023-03-22 17:55:22,430 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/046ded3a5111498f9c9c3c20ecc86813 2023-03-22 17:55:22,433 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 046ded3a5111498f9c9c3c20ecc86813 2023-03-22 17:55:22,434 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/e3973f530ff84d7e92fd343d4a52143c 2023-03-22 17:55:22,437 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3973f530ff84d7e92fd343d4a52143c 2023-03-22 17:55:22,446 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/ad41a9509f024fc294b0d601726348bd 2023-03-22 17:55:22,449 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad41a9509f024fc294b0d601726348bd 2023-03-22 17:55:22,450 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/0790cf18b2ac456290bdef41331f4605 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605 2023-03-22 17:55:22,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0790cf18b2ac456290bdef41331f4605 2023-03-22 17:55:22,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605, entries=3, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:22,453 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/ad41a9509f024fc294b0d601726348bd as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd 2023-03-22 17:55:22,456 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad41a9509f024fc294b0d601726348bd 2023-03-22 17:55:22,456 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:22,457 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for dfab92a478307e4a572bc8d39b8084fd in 845ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:22,457 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:22,457 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:22,457 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:22,843 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/29046f1879db460096bd2544875459cd 2023-03-22 17:55:22,849 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29046f1879db460096bd2544875459cd 2023-03-22 17:55:22,850 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/046ded3a5111498f9c9c3c20ecc86813 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813 2023-03-22 17:55:22,854 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 046ded3a5111498f9c9c3c20ecc86813 2023-03-22 17:55:22,854 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813, entries=3, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:22,856 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/29046f1879db460096bd2544875459cd as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd 2023-03-22 17:55:22,861 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29046f1879db460096bd2544875459cd 2023-03-22 17:55:22,861 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:22,862 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6bf4ad76645cab3c5938606f0a9ae870 in 1250ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:22,862 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:22,862 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:22,862 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:23,267 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/9e76de75f1d74d1f9f287b26b9477b60 2023-03-22 17:55:23,271 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e76de75f1d74d1f9f287b26b9477b60 2023-03-22 17:55:23,272 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/e3973f530ff84d7e92fd343d4a52143c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c 2023-03-22 17:55:23,276 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3973f530ff84d7e92fd343d4a52143c 2023-03-22 17:55:23,276 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c, entries=3, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:23,276 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/9e76de75f1d74d1f9f287b26b9477b60 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60 2023-03-22 17:55:23,280 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e76de75f1d74d1f9f287b26b9477b60 2023-03-22 17:55:23,280 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:23,281 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ea758f8595ac567ffe84ee13d88907de in 1669ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:23,281 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:23,281 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-22 17:55:23,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-22 17:55:23,283 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:23,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,283 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:23,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-22 17:55:23,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e8b057d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:23,285 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-22 17:55:23,285 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,287 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-22 17:55:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-22 17:55:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:23,287 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,287 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:23,291 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:23,291 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-22 17:55:23,291 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:23,292 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-22 17:55:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:23,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:23,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:23,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-22 17:55:23,294 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-22 17:55:23,294 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:23,294 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:23,294 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-22 17:55:23,294 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:23,296 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,296 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:23,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,296 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:23,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:23,297 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,299 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-22 17:55:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,302 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-22 17:55:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:23,302 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:23,303 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:23,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:23,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-22 17:55:23,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:23,403 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:23,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:23,404 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:23,404 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): dfab92a478307e4a572bc8d39b8084fd/family1 is initiating major compaction (all files) 2023-03-22 17:55:23,404 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:23,404 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:23,405 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of dfab92a478307e4a572bc8d39b8084fd/family1 in ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:23,406 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp, totalSize=26.6 K 2023-03-22 17:55:23,406 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e55a8d0b4d8d4b2087cccd3f941dd494, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:23,407 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e29a3822aa76458bb8ac36f0227145dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716206 2023-03-22 17:55:23,407 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting b61df3332404477ebc5860eff3e483e6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:23,408 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting bf88d41e9f144ccf85f7a6ce2f2ed87a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:23,408 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 0790cf18b2ac456290bdef41331f4605, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:23,423 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): dfab92a478307e4a572bc8d39b8084fd#family1#compaction#149 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:23,434 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303226e4555ada29e4186b879a011a06479ea_del 2023-03-22 17:55:23,434 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303226e4555ada29e4186b879a011a06479ea_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303226e4555ada29e4186b879a011a06479ea_del 2023-03-22 17:55:23,856 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 821a97c1d918414c96d17f260379f98e 2023-03-22 17:55:23,858 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family1/821a97c1d918414c96d17f260379f98e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/821a97c1d918414c96d17f260379f98e 2023-03-22 17:55:23,862 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 821a97c1d918414c96d17f260379f98e 2023-03-22 17:55:23,863 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dfab92a478307e4a572bc8d39b8084fd/family1 of dfab92a478307e4a572bc8d39b8084fd into 821a97c1d918414c96d17f260379f98e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:23,863 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:23,863 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:23,863 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): dfab92a478307e4a572bc8d39b8084fd/family2 is initiating major compaction (all files) 2023-03-22 17:55:23,864 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:23,864 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:23,864 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of dfab92a478307e4a572bc8d39b8084fd/family2 in ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:23,864 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp, totalSize=25.3 K 2023-03-22 17:55:23,864 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 427255b87f2b4f4da81c2f68ee25f8c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:23,865 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 05c914b98af54ad5b50b5b20aba298a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716206 2023-03-22 17:55:23,865 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 1fe93af778f94227aeffc3f0240762d0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:23,866 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting afb90f4fedb64e9a8cd56dc6f09f6b9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:23,866 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting ad41a9509f024fc294b0d601726348bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:23,881 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): dfab92a478307e4a572bc8d39b8084fd#family2#compaction#150 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:23,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605] to archive 2023-03-22 17:55:23,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:23,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e55a8d0b4d8d4b2087cccd3f941dd494 2023-03-22 17:55:23,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/e29a3822aa76458bb8ac36f0227145dc 2023-03-22 17:55:23,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/b61df3332404477ebc5860eff3e483e6 2023-03-22 17:55:23,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/bf88d41e9f144ccf85f7a6ce2f2ed87a 2023-03-22 17:55:23,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/0790cf18b2ac456290bdef41331f4605 2023-03-22 17:55:24,297 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303224cc782f5d0764cc8a7105ccc852d110f_del 2023-03-22 17:55:24,297 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303224cc782f5d0764cc8a7105ccc852d110f_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303224cc782f5d0764cc8a7105ccc852d110f_del 2023-03-22 17:55:24,710 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67d180d761364eeaba50471d89be2657 2023-03-22 17:55:24,711 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/.tmp/family2/67d180d761364eeaba50471d89be2657 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/67d180d761364eeaba50471d89be2657 2023-03-22 17:55:24,715 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67d180d761364eeaba50471d89be2657 2023-03-22 17:55:24,716 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dfab92a478307e4a572bc8d39b8084fd/family2 of dfab92a478307e4a572bc8d39b8084fd into 67d180d761364eeaba50471d89be2657(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:24,716 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:24,716 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:24,716 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): ea758f8595ac567ffe84ee13d88907de/family1 is initiating major compaction (all files) 2023-03-22 17:55:24,716 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:24,716 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:24,716 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of ea758f8595ac567ffe84ee13d88907de/family1 in ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:24,716 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp, totalSize=26.6 K 2023-03-22 17:55:24,717 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting a55f2b942f3b428d8acbd864522545a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:24,717 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 160d74c5598a48c09188d8b89b480b65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716206 2023-03-22 17:55:24,717 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting baeb9f006a5f4cbeadf92ccf36ca00b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:24,718 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 5391924924524aca95ba4ba52f69bb04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:24,718 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e3973f530ff84d7e92fd343d4a52143c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:24,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd] to archive 2023-03-22 17:55:24,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:24,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/427255b87f2b4f4da81c2f68ee25f8c2 2023-03-22 17:55:24,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/05c914b98af54ad5b50b5b20aba298a7 2023-03-22 17:55:24,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/1fe93af778f94227aeffc3f0240762d0 2023-03-22 17:55:24,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/afb90f4fedb64e9a8cd56dc6f09f6b9f 2023-03-22 17:55:24,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family2/ad41a9509f024fc294b0d601726348bd 2023-03-22 17:55:24,734 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): ea758f8595ac567ffe84ee13d88907de#family1#compaction#151 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:25,147 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303220bf0e5b74f7d46daac2fb36aaa58ae82_del 2023-03-22 17:55:25,147 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303220bf0e5b74f7d46daac2fb36aaa58ae82_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303220bf0e5b74f7d46daac2fb36aaa58ae82_del 2023-03-22 17:55:25,180 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2189ecf76fc8495d97fab188648b1b1d 2023-03-22 17:55:25,181 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family1/2189ecf76fc8495d97fab188648b1b1d as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/2189ecf76fc8495d97fab188648b1b1d 2023-03-22 17:55:25,191 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2189ecf76fc8495d97fab188648b1b1d 2023-03-22 17:55:25,192 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ea758f8595ac567ffe84ee13d88907de/family1 of ea758f8595ac567ffe84ee13d88907de into 2189ecf76fc8495d97fab188648b1b1d(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:25,192 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:25,192 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:25,192 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): ea758f8595ac567ffe84ee13d88907de/family2 is initiating major compaction (all files) 2023-03-22 17:55:25,192 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:25,193 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:25,193 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of ea758f8595ac567ffe84ee13d88907de/family2 in ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:25,193 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp, totalSize=25.3 K 2023-03-22 17:55:25,195 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting a44d8d41caf946848716d732b965877a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:25,195 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting ed6636839d6d4af0988f4256801befb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716206 2023-03-22 17:55:25,197 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 275dc5e4c1194166b99427484acdff2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:25,198 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting caec5778d0f748458885ba2c902ff0ea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:25,198 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 9e76de75f1d74d1f9f287b26b9477b60, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:25,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c] to archive 2023-03-22 17:55:25,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:25,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/a55f2b942f3b428d8acbd864522545a0 2023-03-22 17:55:25,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/160d74c5598a48c09188d8b89b480b65 2023-03-22 17:55:25,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/baeb9f006a5f4cbeadf92ccf36ca00b8 2023-03-22 17:55:25,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/5391924924524aca95ba4ba52f69bb04 2023-03-22 17:55:25,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/e3973f530ff84d7e92fd343d4a52143c 2023-03-22 17:55:25,244 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): ea758f8595ac567ffe84ee13d88907de#family2#compaction#152 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:25,271 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303228bda375853734fa9bf9d63fba7a761d6_del 2023-03-22 17:55:25,271 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303228bda375853734fa9bf9d63fba7a761d6_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303228bda375853734fa9bf9d63fba7a761d6_del 2023-03-22 17:55:26,093 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 515262368f7b4bc1b1a7c02ad3d1539a 2023-03-22 17:55:26,093 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/.tmp/family2/515262368f7b4bc1b1a7c02ad3d1539a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/515262368f7b4bc1b1a7c02ad3d1539a 2023-03-22 17:55:26,098 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 515262368f7b4bc1b1a7c02ad3d1539a 2023-03-22 17:55:26,099 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ea758f8595ac567ffe84ee13d88907de/family2 of ea758f8595ac567ffe84ee13d88907de into 515262368f7b4bc1b1a7c02ad3d1539a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:26,099 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:26,099 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:26,099 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 6bf4ad76645cab3c5938606f0a9ae870/family1 is initiating major compaction (all files) 2023-03-22 17:55:26,099 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:26,099 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:26,099 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 6bf4ad76645cab3c5938606f0a9ae870/family1 in ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:26,100 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp, totalSize=26.6 K 2023-03-22 17:55:26,100 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 593af11b87f34f019e3c7a3f2570bfa7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:26,100 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 8b3f09712eb3425d98e47fba395b020e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716207 2023-03-22 17:55:26,101 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 91dabacc924347878d22ab045334fb6f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:26,119 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 71c29b3615e1430da8994765cff695ac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:26,120 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 046ded3a5111498f9c9c3c20ecc86813, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:26,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60] to archive 2023-03-22 17:55:26,120 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:26,120 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f1f0589 to 127.0.0.1:60739 2023-03-22 17:55:26,120 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:26,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:26,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/a44d8d41caf946848716d732b965877a 2023-03-22 17:55:26,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/ed6636839d6d4af0988f4256801befb7 2023-03-22 17:55:26,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/275dc5e4c1194166b99427484acdff2b 2023-03-22 17:55:26,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/caec5778d0f748458885ba2c902ff0ea 2023-03-22 17:55:26,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family2/9e76de75f1d74d1f9f287b26b9477b60 2023-03-22 17:55:26,135 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 6bf4ad76645cab3c5938606f0a9ae870#family1#compaction#153 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:26,544 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303226d391d9b960e41848f471c6e7c8d49d7_del 2023-03-22 17:55:26,544 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303226d391d9b960e41848f471c6e7c8d49d7_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303226d391d9b960e41848f471c6e7c8d49d7_del 2023-03-22 17:55:27,361 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e992d7ccd04250abf678dfbaadcc33 2023-03-22 17:55:27,362 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family1/86e992d7ccd04250abf678dfbaadcc33 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/86e992d7ccd04250abf678dfbaadcc33 2023-03-22 17:55:27,372 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e992d7ccd04250abf678dfbaadcc33 2023-03-22 17:55:27,373 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6bf4ad76645cab3c5938606f0a9ae870/family1 of 6bf4ad76645cab3c5938606f0a9ae870 into 86e992d7ccd04250abf678dfbaadcc33(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:27,374 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:27,374 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:27,374 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 6bf4ad76645cab3c5938606f0a9ae870/family2 is initiating major compaction (all files) 2023-03-22 17:55:27,374 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:27,374 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:27,376 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 6bf4ad76645cab3c5938606f0a9ae870/family2 in ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:27,376 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp, totalSize=25.3 K 2023-03-22 17:55:27,377 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e0c3f43fd2024106b3203ab03088b4ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507714418 2023-03-22 17:55:27,377 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 100297d451eb4752bf76afab43b873f2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507716207 2023-03-22 17:55:27,378 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting bf5a7c0b28d04e73800c18ed2724e98a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507718003 2023-03-22 17:55:27,378 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting fa29443665424c3abba33b32ad5168d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507719784 2023-03-22 17:55:27,378 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 29046f1879db460096bd2544875459cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:27,388 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 6bf4ad76645cab3c5938606f0a9ae870#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:27,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813] to archive 2023-03-22 17:55:27,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:27,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/593af11b87f34f019e3c7a3f2570bfa7 2023-03-22 17:55:27,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/8b3f09712eb3425d98e47fba395b020e 2023-03-22 17:55:27,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/91dabacc924347878d22ab045334fb6f 2023-03-22 17:55:27,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/71c29b3615e1430da8994765cff695ac 2023-03-22 17:55:27,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/046ded3a5111498f9c9c3c20ecc86813 2023-03-22 17:55:27,799 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230322475276902c54486e85716edafe7ab92d_del 2023-03-22 17:55:27,799 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322475276902c54486e85716edafe7ab92d_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230322475276902c54486e85716edafe7ab92d_del 2023-03-22 17:55:28,213 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8db93d158b944113a61168731617a712 2023-03-22 17:55:28,214 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/.tmp/family2/8db93d158b944113a61168731617a712 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/8db93d158b944113a61168731617a712 2023-03-22 17:55:28,218 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8db93d158b944113a61168731617a712 2023-03-22 17:55:28,219 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6bf4ad76645cab3c5938606f0a9ae870/family2 of 6bf4ad76645cab3c5938606f0a9ae870 into 8db93d158b944113a61168731617a712(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:28,219 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:28,223 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:28,226 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:28,229 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:28,230 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:28,237 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:55:28,251 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-22 17:55:28,254 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303220bf0e5b74f7d46daac2fb36aaa58ae82_del 2023-03-22 17:55:28,257 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303226e4555ada29e4186b879a011a06479ea_del 2023-03-22 17:55:28,260 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303226d391d9b960e41848f471c6e7c8d49d7_del 2023-03-22 17:55:28,260 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:28,260 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(139): Connect 0x3e02167d to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:28,264 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9f7cda6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:28,266 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:28,266 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:28,266 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:28,315 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303224a08bc6f9e8b4ef1b14b262f3f07cd91 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303224a08bc6f9e8b4ef1b14b262f3f07cd91 2023-03-22 17:55:28,315 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322fb8bc6fadd464b78ad3e35b0285ff032 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230322fb8bc6fadd464b78ad3e35b0285ff032 2023-03-22 17:55:28,316 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:28,316 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:28,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd] to archive 2023-03-22 17:55:28,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:28,331 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:28,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/e0c3f43fd2024106b3203ab03088b4ca 2023-03-22 17:55:28,334 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:28,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/100297d451eb4752bf76afab43b873f2 2023-03-22 17:55:28,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/bf5a7c0b28d04e73800c18ed2724e98a 2023-03-22 17:55:28,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/fa29443665424c3abba33b32ad5168d6 2023-03-22 17:55:28,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family2/29046f1879db460096bd2544875459cd 2023-03-22 17:55:28,346 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:55:28,361 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:55:28,391 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230322/family1/c9b812f071eb41dcaf1cf46108a35325 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-22 17:55:28,392 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230322/family1/c9b812f071eb41dcaf1cf46108a35325}] 2023-03-22 17:55:28,394 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230322/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-22 17:55:28,394 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230322/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff}] 2023-03-22 17:55:28,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230322/family1/c9b812f071eb41dcaf1cf46108a35325 for inclusion in dfab92a478307e4a572bc8d39b8084fd/family1 2023-03-22 17:55:28,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230322/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff for inclusion in 6bf4ad76645cab3c5938606f0a9ae870/family1 2023-03-22 17:55:28,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-22 17:55:28,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-22 17:55:28,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-22 17:55:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-22 17:55:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230322/family1/c9b812f071eb41dcaf1cf46108a35325 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__kgvs6148b9atfia3b410vs5g9l1h5hfb0n0uaa0oqflfj7uofvh3jshr2s0guae5/family1/c9b812f071eb41dcaf1cf46108a35325 2023-03-22 17:55:28,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230322/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__njpo6lm77hu12jev6rhjqvckudr7ib4slkgjiuo43ogpvu6tpj95s2b1j722fr99/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff 2023-03-22 17:55:28,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__kgvs6148b9atfia3b410vs5g9l1h5hfb0n0uaa0oqflfj7uofvh3jshr2s0guae5/family1/c9b812f071eb41dcaf1cf46108a35325 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/951691baefa14d4191cd8b5980ccad1a_SeqId_28_ 2023-03-22 17:55:28,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__njpo6lm77hu12jev6rhjqvckudr7ib4slkgjiuo43ogpvu6tpj95s2b1j722fr99/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/0fac7df52ee0482e9214baedc2ecc7a8_SeqId_28_ 2023-03-22 17:55:28,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__kgvs6148b9atfia3b410vs5g9l1h5hfb0n0uaa0oqflfj7uofvh3jshr2s0guae5/family1/c9b812f071eb41dcaf1cf46108a35325 into dfab92a478307e4a572bc8d39b8084fd/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/951691baefa14d4191cd8b5980ccad1a_SeqId_28_ - updating store file list. 2023-03-22 17:55:28,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__njpo6lm77hu12jev6rhjqvckudr7ib4slkgjiuo43ogpvu6tpj95s2b1j722fr99/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff into 6bf4ad76645cab3c5938606f0a9ae870/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/0fac7df52ee0482e9214baedc2ecc7a8_SeqId_28_ - updating store file list. 2023-03-22 17:55:28,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/0fac7df52ee0482e9214baedc2ecc7a8_SeqId_28_ into 6bf4ad76645cab3c5938606f0a9ae870/family1 2023-03-22 17:55:28,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__njpo6lm77hu12jev6rhjqvckudr7ib4slkgjiuo43ogpvu6tpj95s2b1j722fr99/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff into 6bf4ad76645cab3c5938606f0a9ae870/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/family1/0fac7df52ee0482e9214baedc2ecc7a8_SeqId_28_) 2023-03-22 17:55:28,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__njpo6lm77hu12jev6rhjqvckudr7ib4slkgjiuo43ogpvu6tpj95s2b1j722fr99/family1/c8e77d9ed809489fa7fe5ea1ab25c1ff 2023-03-22 17:55:28,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/951691baefa14d4191cd8b5980ccad1a_SeqId_28_ into dfab92a478307e4a572bc8d39b8084fd/family1 2023-03-22 17:55:28,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__kgvs6148b9atfia3b410vs5g9l1h5hfb0n0uaa0oqflfj7uofvh3jshr2s0guae5/family1/c9b812f071eb41dcaf1cf46108a35325 into dfab92a478307e4a572bc8d39b8084fd/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/family1/951691baefa14d4191cd8b5980ccad1a_SeqId_28_) 2023-03-22 17:55:28,420 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:28,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__kgvs6148b9atfia3b410vs5g9l1h5hfb0n0uaa0oqflfj7uofvh3jshr2s0guae5/family1/c9b812f071eb41dcaf1cf46108a35325 2023-03-22 17:55:28,421 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:28,422 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303227b66e796851347dea0c25e80cefe8687 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303227b66e796851347dea0c25e80cefe8687 2023-03-22 17:55:28,423 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-22 17:55:28,423 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230322' 2023-03-22 17:55:28,423 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:28,423 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:28,424 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:28,425 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230322a5ef305d2d8c4bc4a093d9da0045f19b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230322a5ef305d2d8c4bc4a093d9da0045f19b 2023-03-22 17:55:28,425 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-22 17:55:28,425 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230322' 2023-03-22 17:55:28,425 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:29,118 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303220d5b137763a546b582ff1108b60669c2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303220d5b137763a546b582ff1108b60669c2 2023-03-22 17:55:29,118 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:29,151 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/family1/c6568ecd755b4456a4ce9c5bd5b7c446 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-22 17:55:29,152 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/family1/c6568ecd755b4456a4ce9c5bd5b7c446}] 2023-03-22 17:55:29,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/family1/c6568ecd755b4456a4ce9c5bd5b7c446 for inclusion in ea758f8595ac567ffe84ee13d88907de/family1 2023-03-22 17:55:29,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-22 17:55:29,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last=1 2023-03-22 17:55:29,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:29,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230322/family1/c6568ecd755b4456a4ce9c5bd5b7c446 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__lurag335bovle39h8gjbk5ddk4c6vk3hke8as5v4nd2pcvf4mif5ji3l2cv3rauf/family1/c6568ecd755b4456a4ce9c5bd5b7c446 2023-03-22 17:55:29,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__lurag335bovle39h8gjbk5ddk4c6vk3hke8as5v4nd2pcvf4mif5ji3l2cv3rauf/family1/c6568ecd755b4456a4ce9c5bd5b7c446 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/7d2735c895514fc8bf69dc57a2b5b9a0_SeqId_28_ 2023-03-22 17:55:29,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__lurag335bovle39h8gjbk5ddk4c6vk3hke8as5v4nd2pcvf4mif5ji3l2cv3rauf/family1/c6568ecd755b4456a4ce9c5bd5b7c446 into ea758f8595ac567ffe84ee13d88907de/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/7d2735c895514fc8bf69dc57a2b5b9a0_SeqId_28_ - updating store file list. 2023-03-22 17:55:29,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/7d2735c895514fc8bf69dc57a2b5b9a0_SeqId_28_ into ea758f8595ac567ffe84ee13d88907de/family1 2023-03-22 17:55:29,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__lurag335bovle39h8gjbk5ddk4c6vk3hke8as5v4nd2pcvf4mif5ji3l2cv3rauf/family1/c6568ecd755b4456a4ce9c5bd5b7c446 into ea758f8595ac567ffe84ee13d88907de/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/family1/7d2735c895514fc8bf69dc57a2b5b9a0_SeqId_28_) 2023-03-22 17:55:29,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__ns_testMinorCompaction__lurag335bovle39h8gjbk5ddk4c6vk3hke8as5v4nd2pcvf4mif5ji3l2cv3rauf/family1/c6568ecd755b4456a4ce9c5bd5b7c446 2023-03-22 17:55:29,169 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:29,170 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:29,171 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230322000b51e7dbee4ac5bdf3b3e3142cbd96 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230322000b51e7dbee4ac5bdf3b3e3142cbd96 2023-03-22 17:55:29,171 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-22 17:55:29,171 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230322' 2023-03-22 17:55:29,172 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230322 for table='ns:testMinorCompaction' and column='family1' 2023-03-22 17:55:29,172 INFO [Listener at localhost/34365] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-22 17:55:29,174 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:29,177 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:29,180 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:29,181 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:29,201 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 283), OpenFileDescriptor=628 (was 737), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 308), ProcessCount=169 (was 169), AvailableMemoryMB=5861 (was 5876) 2023-03-22 17:55:29,215 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=169, AvailableMemoryMB=5860 2023-03-22 17:55:29,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-22 17:55:29,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:29,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:55:29,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-22 17:55:29,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:55:29,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:29,222 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:29,222 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482 empty. 2023-03-22 17:55:29,223 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:29,223 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-22 17:55:29,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:29,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:29,638 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-22 17:55:29,639 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5724222967b26b81b2994ecd84a2482, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:29,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing d5724222967b26b81b2994ecd84a2482, disabling compactions & flushes 2023-03-22 17:55:30,045 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. after waiting 0 ms 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,045 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:30,047 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:55:30,049 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507730049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507730049"}]},"ts":"1679507730049"} 2023-03-22 17:55:30,050 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-22 17:55:30,051 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:55:30,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507730051"}]},"ts":"1679507730051"} 2023-03-22 17:55:30,052 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-22 17:55:30,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d5724222967b26b81b2994ecd84a2482, ASSIGN}] 2023-03-22 17:55:30,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d5724222967b26b81b2994ecd84a2482, ASSIGN 2023-03-22 17:55:30,057 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d5724222967b26b81b2994ecd84a2482, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:30,208 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d5724222967b26b81b2994ecd84a2482, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:30,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507730208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507730208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507730208"}]},"ts":"1679507730208"} 2023-03-22 17:55:30,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure d5724222967b26b81b2994ecd84a2482, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:30,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:30,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5724222967b26b81b2994ecd84a2482, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.', STARTKEY => '', ENDKEY => ''} 2023-03-22 17:55:30,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:30,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,365 INFO [StoreOpener-d5724222967b26b81b2994ecd84a2482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,367 DEBUG [StoreOpener-d5724222967b26b81b2994ecd84a2482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:30,367 DEBUG [StoreOpener-d5724222967b26b81b2994ecd84a2482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:30,367 INFO [StoreOpener-d5724222967b26b81b2994ecd84a2482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5724222967b26b81b2994ecd84a2482 columnFamilyName family1 2023-03-22 17:55:30,368 INFO [StoreOpener-d5724222967b26b81b2994ecd84a2482-1] regionserver.HStore(310): Store=d5724222967b26b81b2994ecd84a2482/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:30,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:30,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5724222967b26b81b2994ecd84a2482; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59005006, jitterRate=-0.12075689435005188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-22 17:55:30,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:30,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., pid=114, masterSystemTime=1679507730361 2023-03-22 17:55:30,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:30,377 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=d5724222967b26b81b2994ecd84a2482, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:30,377 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679507730377"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507730377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507730377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507730377"}]},"ts":"1679507730377"} 2023-03-22 17:55:30,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-22 17:55:30,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure d5724222967b26b81b2994ecd84a2482, server=jenkins-hbase4.apache.org,46619,1679507617635 in 168 msec 2023-03-22 17:55:30,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-22 17:55:30,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=d5724222967b26b81b2994ecd84a2482, ASSIGN in 324 msec 2023-03-22 17:55:30,382 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:55:30,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507730382"}]},"ts":"1679507730382"} 2023-03-22 17:55:30,383 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-22 17:55:30,386 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:55:30,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1690 sec 2023-03-22 17:55:31,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-22 17:55:31,326 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-22 17:55:31,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,368 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:31,368 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:31,368 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:31,368 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:31,369 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,369 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,370 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:31,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:31,370 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:31,371 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,371 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:31,376 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:31,376 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:31,378 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-22 17:55:31,450 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130760afabdd76f48a0bedc31d997b9ee8f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130760afabdd76f48a0bedc31d997b9ee8f 2023-03-22 17:55:31,453 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/1d33559ad15048b8b6cb2d203b515ba2 2023-03-22 17:55:31,457 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/1d33559ad15048b8b6cb2d203b515ba2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2 2023-03-22 17:55:31,461 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-22 17:55:31,462 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 84ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:31,462 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:31,463 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:31,463 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:31,465 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,465 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,466 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:31,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:31,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d31f031[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:31,467 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:31,467 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,469 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,469 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:31,469 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:31,469 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:31,469 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,469 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:31,470 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:31,470 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,470 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:31,470 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:31,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:31,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:31,473 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:31,473 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:31,473 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:31,473 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,473 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:31,475 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,475 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,475 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:31,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:31,475 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:31,476 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:31,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:31,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:31,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:31,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:31,481 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:31,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:31,482 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:31,482 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:31,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:31,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:31,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:55:31,582 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:31,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:31,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:31,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:31,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,589 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:31,589 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:31,589 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:31,589 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:31,589 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,589 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,591 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:31,591 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:31,591 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:31,591 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,592 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,592 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:31,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:31,593 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:31,593 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:31,593 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:31,593 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:31,593 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-22 17:55:32,010 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112872fe00ca9c5a4f1f9cf11f491459f4d7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112872fe00ca9c5a4f1f9cf11f491459f4d7 2023-03-22 17:55:32,424 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/5942164d03b04ec3aabbf52d51d0a6c4 2023-03-22 17:55:32,429 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/5942164d03b04ec3aabbf52d51d0a6c4 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4 2023-03-22 17:55:32,433 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4, entries=1, sequenceid=9, filesize=5.0 K 2023-03-22 17:55:32,434 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 841ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:32,435 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:32,435 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:32,437 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:32,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:32,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d98644d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:32,439 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:32,439 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,440 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:32,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:32,441 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:32,441 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,441 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:32,443 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:32,443 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:32,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:32,446 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:32,446 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:32,446 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:32,446 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,446 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:32,447 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:32,447 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,448 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:32,448 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,449 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,453 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:32,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:32,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:32,453 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:32,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:32,553 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:32,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:32,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,564 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:32,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:32,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:32,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:32,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,564 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,569 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:32,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:32,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:32,569 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:32,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:32,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:32,576 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:32,576 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:32,576 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:32,576 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:32,576 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:32,591 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014e0def2e40ea4c118a7693f6f2871770 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e0def2e40ea4c118a7693f6f2871770 2023-03-22 17:55:33,000 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/373754df88f54a3dbe3fe4e9cbb70579 2023-03-22 17:55:33,005 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/373754df88f54a3dbe3fe4e9cbb70579 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579 2023-03-22 17:55:33,009 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579, entries=1, sequenceid=13, filesize=4.9 K 2023-03-22 17:55:33,010 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 434ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:33,010 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:33,010 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:33,010 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:33,012 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,012 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,012 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,012 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:33,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66bd5c6[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:33,014 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:33,014 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,016 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:33,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:33,016 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:33,016 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,016 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:33,018 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:33,018 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,018 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,018 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:33,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:33,021 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:33,021 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:33,021 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:33,021 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,021 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:33,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,023 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,024 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,025 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,027 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,027 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,027 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:33,027 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,027 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,028 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,128 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:33,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:33,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:33,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:33,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,134 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,134 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,134 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:33,134 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:33,135 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,135 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,136 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,136 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,137 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,137 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:33,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:33,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,137 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:33,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,138 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:33,138 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,138 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:33,138 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:33,138 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:33,138 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,138 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:33,138 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:33,152 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059ccd9ebe7f27495899b29b869614014b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059ccd9ebe7f27495899b29b869614014b 2023-03-22 17:55:33,157 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/62372529af8c4ffc907f68534ea232a8 2023-03-22 17:55:33,160 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/62372529af8c4ffc907f68534ea232a8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8 2023-03-22 17:55:33,163 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8, entries=1, sequenceid=17, filesize=4.9 K 2023-03-22 17:55:33,164 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 26ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:33,164 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:33,164 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,164 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:33,164 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:33,164 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,165 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:33,165 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:33,167 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:33,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@400d989b[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:33,169 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:33,169 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,170 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,170 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:33,170 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:33,170 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,170 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:33,170 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:33,172 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,172 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,172 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,172 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:33,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:33,174 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:33,174 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:33,174 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:33,174 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,174 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:33,176 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,176 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,176 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,177 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,178 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,181 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,181 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,181 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,181 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,181 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:33,181 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:33,182 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:33,282 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:33,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:33,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:33,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:33,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,288 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:33,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:33,289 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,289 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,297 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,297 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,297 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,297 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:33,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:33,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,298 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:33,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:33,299 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:33,299 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,299 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:33,299 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:33,710 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c5b64f0bb98c407e8a0ccbafe4e8fc7b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c5b64f0bb98c407e8a0ccbafe4e8fc7b 2023-03-22 17:55:33,714 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/1b1dcbceda094971a04c595e5a2be43d 2023-03-22 17:55:33,718 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/1b1dcbceda094971a04c595e5a2be43d as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d 2023-03-22 17:55:33,722 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d, entries=1, sequenceid=21, filesize=4.9 K 2023-03-22 17:55:33,723 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 424ms, sequenceid=21, compaction requested=true 2023-03-22 17:55:33,723 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:33,723 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:33,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:33,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:33,723 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:33,726 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,726 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,727 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,727 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:33,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12ef48d3[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:33,734 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:33,734 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,735 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:33,736 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,736 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:33,738 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:33,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:33,741 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:33,742 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:33,742 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:33,742 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,742 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:33,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,743 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,745 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,747 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,752 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,752 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:55:33,753 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,752 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:33,752 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:33,753 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:33,853 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:33,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:33,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:33,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,860 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,860 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,860 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:33,860 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:33,860 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,861 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,863 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,863 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,863 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,863 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:33,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,864 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,864 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:33,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:33,864 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,864 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:33,865 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:33,883 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a7d2f16966ee4da0aa704481112733ee to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7d2f16966ee4da0aa704481112733ee 2023-03-22 17:55:33,889 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/3e4158b5ebc84fe4b8cbcdeec7c57283 2023-03-22 17:55:33,894 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/3e4158b5ebc84fe4b8cbcdeec7c57283 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283 2023-03-22 17:55:33,898 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283, entries=1, sequenceid=25, filesize=4.9 K 2023-03-22 17:55:33,899 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 34ms, sequenceid=25, compaction requested=true 2023-03-22 17:55:33,899 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:33,899 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:33,901 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,902 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,902 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,902 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:33,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c0beccf[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:33,904 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:33,904 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,905 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,905 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:33,905 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:33,906 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:33,906 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,906 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:33,909 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:33,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:33,913 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:33,913 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:33,913 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:33,913 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,913 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:33,916 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,916 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,916 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:33,917 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:33,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,924 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:33,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,926 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,926 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,926 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,927 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:33,927 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:33,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:33,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:34,027 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:34,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:34,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:34,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:34,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,033 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:34,033 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:34,033 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:34,033 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:34,034 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,034 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,035 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:34,035 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:34,035 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,035 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:34,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:34,037 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:34,037 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:34,037 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:34,037 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:34,037 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:34,048 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010141503c36062045a8887f95cffc732f23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141503c36062045a8887f95cffc732f23 2023-03-22 17:55:34,053 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/b4b9bac5da6f401c868513b48714207e 2023-03-22 17:55:34,057 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/b4b9bac5da6f401c868513b48714207e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e 2023-03-22 17:55:34,060 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e, entries=1, sequenceid=29, filesize=4.9 K 2023-03-22 17:55:34,061 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 24ms, sequenceid=29, compaction requested=true 2023-03-22 17:55:34,061 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:34,061 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:34,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:34,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:34,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,061 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:34,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:34,067 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,067 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:34,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:34,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:34,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:34,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1496d56d[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:34,069 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:34,069 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,070 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,070 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,070 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:34,070 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:34,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:34,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:34,072 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:34,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:34,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:34,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:34,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:34,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:34,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:34,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:34,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:34,083 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:34,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:34,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:34,083 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,083 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:34,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:34,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,087 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,092 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,095 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,096 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:34,096 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:34,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:34,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:34,096 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:34,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:34,096 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:34,096 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:34,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:34,196 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:34,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:34,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:34,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:34,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,203 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:34,203 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:34,203 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:34,203 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:34,204 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,204 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,205 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:34,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:34,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:34,205 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,205 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:34,205 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:34,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,206 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:34,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:34,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:34,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:34,207 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:34,207 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:34,207 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:34,207 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:34,644 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103623e71f9c5aa4194821a90aaec838f73 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103623e71f9c5aa4194821a90aaec838f73 2023-03-22 17:55:35,050 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/5676259eef4b44548f9ad91f6e167abc 2023-03-22 17:55:35,055 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/5676259eef4b44548f9ad91f6e167abc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc 2023-03-22 17:55:35,059 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc, entries=1, sequenceid=33, filesize=4.9 K 2023-03-22 17:55:35,059 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 852ms, sequenceid=33, compaction requested=true 2023-03-22 17:55:35,060 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:35,060 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:35,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:35,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:35,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:35,060 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:35,061 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,062 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:35,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@434cd374[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:35,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:35,063 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,065 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,065 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:35,065 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:35,065 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:35,065 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,065 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:35,068 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:35,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,068 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:35,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:35,070 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:35,070 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:35,070 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:35,070 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,070 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:35,072 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,072 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,072 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,073 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:35,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:35,080 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:35,080 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,081 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:35,081 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,181 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:35,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:35,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:35,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:35,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,191 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:35,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:35,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:35,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:35,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,192 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,194 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:35,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:35,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,194 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,202 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:35,202 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:35,202 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:35,203 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:35,203 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:35,205 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:35,231 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b302917e1625470785a6686a04f63a0a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907b302917e1625470785a6686a04f63a0a 2023-03-22 17:55:35,258 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/f3417c18ee88430ca515d605af3d799f 2023-03-22 17:55:35,265 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/f3417c18ee88430ca515d605af3d799f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f 2023-03-22 17:55:35,269 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f, entries=1, sequenceid=37, filesize=4.9 K 2023-03-22 17:55:35,271 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 66ms, sequenceid=37, compaction requested=true 2023-03-22 17:55:35,271 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:35,271 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:35,271 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:35,273 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,273 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,274 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,274 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:35,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61535bcd[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:35,275 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:35,275 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,278 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:35,278 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:35,279 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,280 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:35,281 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:35,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,281 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:35,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:35,285 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:35,285 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:35,285 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:35,285 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,285 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:35,288 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,288 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,288 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,288 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,290 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,292 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:35,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:35,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:35,292 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,293 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:35,293 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:35,293 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:35,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-22 17:55:35,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,393 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:35,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:35,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,400 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:35,400 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:35,400 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-22 17:55:35,400 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-22 17:55:35,401 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,401 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,402 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:35,402 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:35,403 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,403 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:35,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,405 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,405 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-22 17:55:35,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-22 17:55:35,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:35,405 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-22 17:55:35,407 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-22 17:55:35,407 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:35,407 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:35,407 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. started... 2023-03-22 17:55:35,407 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5724222967b26b81b2994ecd84a2482 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-22 17:55:35,439 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207afd86463ea74617a288b9076dc69f04 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207afd86463ea74617a288b9076dc69f04 2023-03-22 17:55:35,460 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/2ea643ac67c44721a0bf0c4c39fb93c1 2023-03-22 17:55:35,466 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/2ea643ac67c44721a0bf0c4c39fb93c1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1 2023-03-22 17:55:35,471 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1, entries=1, sequenceid=41, filesize=4.9 K 2023-03-22 17:55:35,472 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d5724222967b26b81b2994ecd84a2482 in 65ms, sequenceid=41, compaction requested=true 2023-03-22 17:55:35,472 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:35,472 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:35,472 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-22 17:55:35,472 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-22 17:55:35,472 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,472 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-22 17:55:35,472 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-22 17:55:35,474 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,474 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-22 17:55:35,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4373bbad[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:35,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-22 17:55:35,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,481 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-22 17:55:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-22 17:55:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:35,483 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-22 17:55:35,483 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,483 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-22 17:55:35,483 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,483 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-22 17:55:35,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:35,484 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-22 17:55:35,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:35,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:35,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,484 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:35,487 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,487 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:35,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,487 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,488 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:35,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:35,492 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,496 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:35,496 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:35,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:35,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:35,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:35,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,497 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,497 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:35,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-22 17:55:35,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:35,498 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:35,498 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:35,598 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:35,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:35,600 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-22 17:55:35,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:55:35,603 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:55:35,603 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508335603 2023-03-22 17:55:35,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:55:35,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-22 17:55:35,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-22 17:55:35,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:35,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x33644fb1 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:35,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b820ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:35,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:35,911 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:55:36,061 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fa3bf58438b74e9eb15689221747ab3f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103fa3bf58438b74e9eb15689221747ab3f 2023-03-22 17:55:36,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:36,075 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:36,077 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:36,083 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:55:36,084 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:55:36,097 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78e347c4705e4285b200eefa006ece56 first=Optional[r5] last=Optional[r6] 2023-03-22 17:55:36,099 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78e347c4705e4285b200eefa006ece56}] 2023-03-22 17:55:36,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78e347c4705e4285b200eefa006ece56 for inclusion in d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:36,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-22 17:55:36,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:55:36,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:36,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/78e347c4705e4285b200eefa006ece56 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o3krm85mg41im14k2bi17um68s70vo066596ecc0l00q5eokk4d9k9c149dlm0k4/family1/78e347c4705e4285b200eefa006ece56 2023-03-22 17:55:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o3krm85mg41im14k2bi17um68s70vo066596ecc0l00q5eokk4d9k9c149dlm0k4/family1/78e347c4705e4285b200eefa006ece56 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_ 2023-03-22 17:55:36,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o3krm85mg41im14k2bi17um68s70vo066596ecc0l00q5eokk4d9k9c149dlm0k4/family1/78e347c4705e4285b200eefa006ece56 into d5724222967b26b81b2994ecd84a2482/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_ - updating store file list. 2023-03-22 17:55:36,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_ into d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:36,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o3krm85mg41im14k2bi17um68s70vo066596ecc0l00q5eokk4d9k9c149dlm0k4/family1/78e347c4705e4285b200eefa006ece56 into d5724222967b26b81b2994ecd84a2482/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_) 2023-03-22 17:55:36,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__o3krm85mg41im14k2bi17um68s70vo066596ecc0l00q5eokk4d9k9c149dlm0k4/family1/78e347c4705e4285b200eefa006ece56 2023-03-22 17:55:36,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-22 17:55:36,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-22 17:55:36,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): d5724222967b26b81b2994ecd84a2482/family1 is initiating minor compaction 2023-03-22 17:55:36,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@36881ba2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:36,118 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d5724222967b26b81b2994ecd84a2482/family1 in testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:36,119 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp, totalSize=49.7 K 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5942164d03b04ec3aabbf52d51d0a6c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 373754df88f54a3dbe3fe4e9cbb70579, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 62372529af8c4ffc907f68534ea232a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1b1dcbceda094971a04c595e5a2be43d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 3e4158b5ebc84fe4b8cbcdeec7c57283, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting b4b9bac5da6f401c868513b48714207e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 5676259eef4b44548f9ad91f6e167abc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting f3417c18ee88430ca515d605af3d799f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2ea643ac67c44721a0bf0c4c39fb93c1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-22 17:55:36,119 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 2edd0f3208664d349a13241b4b8c84da_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-22 17:55:36,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:36,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:36,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141503c36062045a8887f95cffc732f23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141503c36062045a8887f95cffc732f23 2023-03-22 17:55:36,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103623e71f9c5aa4194821a90aaec838f73 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103623e71f9c5aa4194821a90aaec838f73 2023-03-22 17:55:36,125 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-22 17:55:36,125 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-22 17:55:36,126 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:36,126 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:36,188 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): d5724222967b26b81b2994ecd84a2482#family1#compaction#165 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:36,640 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/539d1bc6fa264ea9bfa5b1ea0716748b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/539d1bc6fa264ea9bfa5b1ea0716748b 2023-03-22 17:55:36,646 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d5724222967b26b81b2994ecd84a2482/family1 of d5724222967b26b81b2994ecd84a2482 into 539d1bc6fa264ea9bfa5b1ea0716748b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:36,646 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:36,646 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679507736118; duration=0sec 2023-03-22 17:55:36,646 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:36,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_] to archive 2023-03-22 17:55:36,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:36,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5942164d03b04ec3aabbf52d51d0a6c4 2023-03-22 17:55:36,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/373754df88f54a3dbe3fe4e9cbb70579 2023-03-22 17:55:36,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/62372529af8c4ffc907f68534ea232a8 2023-03-22 17:55:36,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1b1dcbceda094971a04c595e5a2be43d 2023-03-22 17:55:36,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3e4158b5ebc84fe4b8cbcdeec7c57283 2023-03-22 17:55:36,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/b4b9bac5da6f401c868513b48714207e 2023-03-22 17:55:36,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/5676259eef4b44548f9ad91f6e167abc 2023-03-22 17:55:36,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/f3417c18ee88430ca515d605af3d799f 2023-03-22 17:55:36,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2ea643ac67c44721a0bf0c4c39fb93c1 2023-03-22 17:55:36,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/2edd0f3208664d349a13241b4b8c84da_SeqId_44_ 2023-03-22 17:55:37,026 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317eaf296244d14725b8079a5f8d291c36 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512317eaf296244d14725b8079a5f8d291c36 2023-03-22 17:55:37,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:37,065 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b0869f795784d88ab85b2017abec7d0 first=Optional[r1] last=Optional[r4] 2023-03-22 17:55:37,068 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b0869f795784d88ab85b2017abec7d0}] 2023-03-22 17:55:37,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b0869f795784d88ab85b2017abec7d0 for inclusion in d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:37,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-22 17:55:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:55:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b0869f795784d88ab85b2017abec7d0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ra486ac5ig4uuaqtabvklkbqrd6vq48ikb2d8tmpn271tvvoo028maljp55trk8/family1/4b0869f795784d88ab85b2017abec7d0 2023-03-22 17:55:37,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ra486ac5ig4uuaqtabvklkbqrd6vq48ikb2d8tmpn271tvvoo028maljp55trk8/family1/4b0869f795784d88ab85b2017abec7d0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_ 2023-03-22 17:55:37,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ra486ac5ig4uuaqtabvklkbqrd6vq48ikb2d8tmpn271tvvoo028maljp55trk8/family1/4b0869f795784d88ab85b2017abec7d0 into d5724222967b26b81b2994ecd84a2482/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_ - updating store file list. 2023-03-22 17:55:37,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_ into d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:37,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ra486ac5ig4uuaqtabvklkbqrd6vq48ikb2d8tmpn271tvvoo028maljp55trk8/family1/4b0869f795784d88ab85b2017abec7d0 into d5724222967b26b81b2994ecd84a2482/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_) 2023-03-22 17:55:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ra486ac5ig4uuaqtabvklkbqrd6vq48ikb2d8tmpn271tvvoo028maljp55trk8/family1/4b0869f795784d88ab85b2017abec7d0 2023-03-22 17:55:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-22 17:55:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-22 17:55:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(1912): d5724222967b26b81b2994ecd84a2482/family1 is initiating minor compaction (all files) 2023-03-22 17:55:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43365f7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:37,085 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d5724222967b26b81b2994ecd84a2482/family1 in testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:37,085 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/539d1bc6fa264ea9bfa5b1ea0716748b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp, totalSize=178.1 K 2023-03-22 17:55:37,086 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 1d33559ad15048b8b6cb2d203b515ba2, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841570 2023-03-22 17:55:37,087 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting 539d1bc6fa264ea9bfa5b1ea0716748b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241570 2023-03-22 17:55:37,088 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] compactions.Compactor(207): Compacting d7a4558f5452455a81b300822b74441e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241570 2023-03-22 17:55:37,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:37,090 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:37,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e0def2e40ea4c118a7693f6f2871770 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e0def2e40ea4c118a7693f6f2871770 2023-03-22 17:55:37,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059ccd9ebe7f27495899b29b869614014b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059ccd9ebe7f27495899b29b869614014b 2023-03-22 17:55:37,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c5b64f0bb98c407e8a0ccbafe4e8fc7b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c5b64f0bb98c407e8a0ccbafe4e8fc7b 2023-03-22 17:55:37,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7d2f16966ee4da0aa704481112733ee to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7d2f16966ee4da0aa704481112733ee 2023-03-22 17:55:37,099 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-22 17:55:37,099 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-22 17:55:37,100 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:37,100 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:37,126 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] throttle.PressureAwareThroughputController(145): d5724222967b26b81b2994ecd84a2482#family1#compaction#166 average throughput is 5.76 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:38,036 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306e38ebd0749c4292a8737a406df3c3b7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306e38ebd0749c4292a8737a406df3c3b7 2023-03-22 17:55:38,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:38,063 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/402a2f99483a4860be22aa5dacce223b first=Optional[r00] last=Optional[r8] 2023-03-22 17:55:38,063 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/402a2f99483a4860be22aa5dacce223b}] 2023-03-22 17:55:38,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/402a2f99483a4860be22aa5dacce223b for inclusion in d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:38,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-22 17:55:38,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last= 2023-03-22 17:55:38,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:38,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/402a2f99483a4860be22aa5dacce223b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bn0gre1n0f76d2ptj1df2tc0cgs8sv5o0qm3fet4m72ej4aho5i5uqnlb54g3skp/family1/402a2f99483a4860be22aa5dacce223b 2023-03-22 17:55:38,069 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/.tmp/family1/3f91e26ee6e34db48c1eeaa8d60e6612 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/3f91e26ee6e34db48c1eeaa8d60e6612 2023-03-22 17:55:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bn0gre1n0f76d2ptj1df2tc0cgs8sv5o0qm3fet4m72ej4aho5i5uqnlb54g3skp/family1/402a2f99483a4860be22aa5dacce223b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/632498bfc06f47d99bb2e3ad71afcc16_SeqId_49_ 2023-03-22 17:55:38,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bn0gre1n0f76d2ptj1df2tc0cgs8sv5o0qm3fet4m72ej4aho5i5uqnlb54g3skp/family1/402a2f99483a4860be22aa5dacce223b into d5724222967b26b81b2994ecd84a2482/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/632498bfc06f47d99bb2e3ad71afcc16_SeqId_49_ - updating store file list. 2023-03-22 17:55:38,074 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d5724222967b26b81b2994ecd84a2482/family1 of d5724222967b26b81b2994ecd84a2482 into 3f91e26ee6e34db48c1eeaa8d60e6612(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:38,075 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:38,075 INFO [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679507737085; duration=0sec 2023-03-22 17:55:38,075 DEBUG [RS:0;jenkins-hbase4:46619-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-22 17:55:38,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/632498bfc06f47d99bb2e3ad71afcc16_SeqId_49_ into d5724222967b26b81b2994ecd84a2482/family1 2023-03-22 17:55:38,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bn0gre1n0f76d2ptj1df2tc0cgs8sv5o0qm3fet4m72ej4aho5i5uqnlb54g3skp/family1/402a2f99483a4860be22aa5dacce223b into d5724222967b26b81b2994ecd84a2482/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/632498bfc06f47d99bb2e3ad71afcc16_SeqId_49_) 2023-03-22 17:55:38,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMinorCompactionWithMonthlyPolicy__bn0gre1n0f76d2ptj1df2tc0cgs8sv5o0qm3fet4m72ej4aho5i5uqnlb54g3skp/family1/402a2f99483a4860be22aa5dacce223b 2023-03-22 17:55:38,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:38,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:38,083 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207afd86463ea74617a288b9076dc69f04 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511207afd86463ea74617a288b9076dc69f04 2023-03-22 17:55:38,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112872fe00ca9c5a4f1f9cf11f491459f4d7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112872fe00ca9c5a4f1f9cf11f491459f4d7 2023-03-22 17:55:38,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130760afabdd76f48a0bedc31d997b9ee8f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130760afabdd76f48a0bedc31d997b9ee8f 2023-03-22 17:55:38,088 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-22 17:55:38,088 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-22 17:55:38,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:38,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:38,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-22 17:55:38,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-22 17:55:38,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:55:38,091 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-22 17:55:38,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4900 sec 2023-03-22 17:55:38,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/539d1bc6fa264ea9bfa5b1ea0716748b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_] to archive 2023-03-22 17:55:38,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:38,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/1d33559ad15048b8b6cb2d203b515ba2 2023-03-22 17:55:38,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/539d1bc6fa264ea9bfa5b1ea0716748b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/539d1bc6fa264ea9bfa5b1ea0716748b 2023-03-22 17:55:38,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_ to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/family1/d7a4558f5452455a81b300822b74441e_SeqId_47_ 2023-03-22 17:55:38,477 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=259 (was 249) - Thread LEAK? -, OpenFileDescriptor=662 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 296) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=5835 (was 5860) 2023-03-22 17:55:38,492 INFO [Listener at localhost/34365] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=259, OpenFileDescriptor=662, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=169, AvailableMemoryMB=5834 2023-03-22 17:55:38,516 DEBUG [Listener at localhost/34365] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-22 17:55:38,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x102\xDA\xB2\x8D\xFA*W\xB4\x1F=\xF17:\xAB\x5C\xE5"\x10#\xC6\xF3\x8C\x12I\x11\xC3:\xEC\xB9\xF9\xB5\xD9\x06\x1E*\x10\x19\x18\x7F.\xFC\xC3~~>=\x5C\xBD\xD2*k\x912\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-22 17:55:38,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-22 17:55:38,580 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-22 17:55:38,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-22 17:55:38,581 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-22 17:55:38,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b empty. 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52 empty. 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4 empty. 2023-03-22 17:55:38,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:38,584 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:38,584 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:38,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-22 17:55:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:38,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:38,995 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-22 17:55:38,996 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => fbb8b34f67283d053be4f901290126d4, NAME => 'testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x102\xDA\xB2\x8D\xFA*W\xB4\x1F=\xF17:\xAB\x5C\xE5"\x10#\xC6\xF3\x8C\x12I\x11\xC3:\xEC\xB9\xF9\xB5\xD9\x06\x1E*\x10\x19\x18\x7F.\xFC\xC3~~>=\x5C\xBD\xD2*k\x912\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:38,996 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7710f9558c323b3df8c9bddcf1414c52, NAME => 'testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x102\xDA\xB2\x8D\xFA*W\xB4\x1F=\xF17:\xAB\x5C\xE5"\x10#\xC6\xF3\x8C\x12I\x11\xC3:\xEC\xB9\xF9\xB5\xD9\x06\x1E*\x10\x19\x18\x7F.\xFC\xC3~~>=\x5C\xBD\xD2*k\x912\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:38,996 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => fabed9683fbe07c602c62c6d810a343b, NAME => 'testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x102\xDA\xB2\x8D\xFA*W\xB4\x1F=\xF17:\xAB\x5C\xE5"\x10#\xC6\xF3\x8C\x12I\x11\xC3:\xEC\xB9\xF9\xB5\xD9\x06\x1E*\x10\x19\x18\x7F.\xFC\xC3~~>=\x5C\xBD\xD2*k\x912\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/.tmp 2023-03-22 17:55:39,012 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,012 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,012 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing fbb8b34f67283d053be4f901290126d4, disabling compactions & flushes 2023-03-22 17:55:39,012 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 7710f9558c323b3df8c9bddcf1414c52, disabling compactions & flushes 2023-03-22 17:55:39,012 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,012 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. after waiting 0 ms 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. after waiting 0 ms 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,013 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,013 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:39,013 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:39,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:39,354 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing fabed9683fbe07c602c62c6d810a343b, disabling compactions & flushes 2023-03-22 17:55:39,418 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. after waiting 0 ms 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,418 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,418 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:39,421 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-22 17:55:39,422 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679507739421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507739421"}]},"ts":"1679507739421"} 2023-03-22 17:55:39,422 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507739421"}]},"ts":"1679507739421"} 2023-03-22 17:55:39,422 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679507739421"}]},"ts":"1679507739421"} 2023-03-22 17:55:39,424 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-22 17:55:39,424 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-22 17:55:39,425 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507739424"}]},"ts":"1679507739424"} 2023-03-22 17:55:39,426 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-22 17:55:39,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fabed9683fbe07c602c62c6d810a343b, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7710f9558c323b3df8c9bddcf1414c52, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbb8b34f67283d053be4f901290126d4, ASSIGN}] 2023-03-22 17:55:39,430 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fabed9683fbe07c602c62c6d810a343b, ASSIGN 2023-03-22 17:55:39,431 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7710f9558c323b3df8c9bddcf1414c52, ASSIGN 2023-03-22 17:55:39,431 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbb8b34f67283d053be4f901290126d4, ASSIGN 2023-03-22 17:55:39,431 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fabed9683fbe07c602c62c6d810a343b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:39,431 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7710f9558c323b3df8c9bddcf1414c52, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:39,431 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbb8b34f67283d053be4f901290126d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46619,1679507617635; forceNewPlan=false, retain=false 2023-03-22 17:55:39,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=fabed9683fbe07c602c62c6d810a343b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=fbb8b34f67283d053be4f901290126d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507739583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507739583"}]},"ts":"1679507739583"} 2023-03-22 17:55:39,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7710f9558c323b3df8c9bddcf1414c52, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,583 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507739583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507739583"}]},"ts":"1679507739583"} 2023-03-22 17:55:39,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679507739583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679507739583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679507739583"}]},"ts":"1679507739583"} 2023-03-22 17:55:39,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure fabed9683fbe07c602c62c6d810a343b, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:39,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure fbb8b34f67283d053be4f901290126d4, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:39,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 7710f9558c323b3df8c9bddcf1414c52, server=jenkins-hbase4.apache.org,46619,1679507617635}] 2023-03-22 17:55:39,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:39,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbb8b34f67283d053be4f901290126d4, NAME => 'testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.', STARTKEY => '2', ENDKEY => ''} 2023-03-22 17:55:39,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,777 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,778 DEBUG [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1 2023-03-22 17:55:39,779 DEBUG [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1 2023-03-22 17:55:39,779 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb8b34f67283d053be4f901290126d4 columnFamilyName family1 2023-03-22 17:55:39,780 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] regionserver.HStore(310): Store=fbb8b34f67283d053be4f901290126d4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,781 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,782 DEBUG [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2 2023-03-22 17:55:39,782 DEBUG [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2 2023-03-22 17:55:39,782 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb8b34f67283d053be4f901290126d4 columnFamilyName family2 2023-03-22 17:55:39,783 INFO [StoreOpener-fbb8b34f67283d053be4f901290126d4-1] regionserver.HStore(310): Store=fbb8b34f67283d053be4f901290126d4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:39,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:39,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:39,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fbb8b34f67283d053be4f901290126d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59348513, jitterRate=-0.11563824117183685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:39,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:39,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4., pid=121, masterSystemTime=1679507739741 2023-03-22 17:55:39,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:39,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fabed9683fbe07c602c62c6d810a343b, NAME => 'testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.', STARTKEY => '', ENDKEY => '1'} 2023-03-22 17:55:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,795 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=fbb8b34f67283d053be4f901290126d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,795 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507739795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507739795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507739795"}]},"ts":"1679507739795"} 2023-03-22 17:55:39,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-22 17:55:39,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure fbb8b34f67283d053be4f901290126d4, server=jenkins-hbase4.apache.org,46619,1679507617635 in 209 msec 2023-03-22 17:55:39,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbb8b34f67283d053be4f901290126d4, ASSIGN in 372 msec 2023-03-22 17:55:39,825 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,826 DEBUG [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1 2023-03-22 17:55:39,826 DEBUG [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1 2023-03-22 17:55:39,826 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fabed9683fbe07c602c62c6d810a343b columnFamilyName family1 2023-03-22 17:55:39,827 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] regionserver.HStore(310): Store=fabed9683fbe07c602c62c6d810a343b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,828 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,829 DEBUG [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2 2023-03-22 17:55:39,829 DEBUG [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2 2023-03-22 17:55:39,829 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fabed9683fbe07c602c62c6d810a343b columnFamilyName family2 2023-03-22 17:55:39,830 INFO [StoreOpener-fabed9683fbe07c602c62c6d810a343b-1] regionserver.HStore(310): Store=fabed9683fbe07c602c62c6d810a343b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:39,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:39,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fabed9683fbe07c602c62c6d810a343b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61937654, jitterRate=-0.07705703377723694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:39,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:39,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b., pid=120, masterSystemTime=1679507739741 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:39,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7710f9558c323b3df8c9bddcf1414c52, NAME => 'testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.', STARTKEY => '1', ENDKEY => '2'} 2023-03-22 17:55:39,838 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=fabed9683fbe07c602c62c6d810a343b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-22 17:55:39,838 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679507739838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507739838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507739838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507739838"}]},"ts":"1679507739838"} 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-03-22 17:55:39,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure fabed9683fbe07c602c62c6d810a343b, server=jenkins-hbase4.apache.org,46619,1679507617635 in 250 msec 2023-03-22 17:55:39,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fabed9683fbe07c602c62c6d810a343b, ASSIGN in 412 msec 2023-03-22 17:55:39,867 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,869 DEBUG [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1 2023-03-22 17:55:39,869 DEBUG [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1 2023-03-22 17:55:39,869 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7710f9558c323b3df8c9bddcf1414c52 columnFamilyName family1 2023-03-22 17:55:39,870 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] regionserver.HStore(310): Store=7710f9558c323b3df8c9bddcf1414c52/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,870 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,871 DEBUG [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2 2023-03-22 17:55:39,872 DEBUG [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2 2023-03-22 17:55:39,872 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-22 17:55:39,872 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7710f9558c323b3df8c9bddcf1414c52 columnFamilyName family2 2023-03-22 17:55:39,873 INFO [StoreOpener-7710f9558c323b3df8c9bddcf1414c52-1] regionserver.HStore(310): Store=7710f9558c323b3df8c9bddcf1414c52/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-22 17:55:39,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-22 17:55:39,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-22 17:55:39,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7710f9558c323b3df8c9bddcf1414c52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73106210, jitterRate=0.08936741948127747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-22 17:55:39,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:39,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52., pid=122, masterSystemTime=1679507739741 2023-03-22 17:55:39,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:39,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7710f9558c323b3df8c9bddcf1414c52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:39,882 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679507739882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679507739882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679507739882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679507739882"}]},"ts":"1679507739882"} 2023-03-22 17:55:39,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-22 17:55:39,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 7710f9558c323b3df8c9bddcf1414c52, server=jenkins-hbase4.apache.org,46619,1679507617635 in 291 msec 2023-03-22 17:55:39,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-22 17:55:39,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7710f9558c323b3df8c9bddcf1414c52, ASSIGN in 455 msec 2023-03-22 17:55:39,886 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-22 17:55:39,887 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679507739886"}]},"ts":"1679507739886"} 2023-03-22 17:55:39,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-22 17:55:39,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-22 17:55:39,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3120 sec 2023-03-22 17:55:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-22 17:55:40,687 INFO [Listener at localhost/34365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-22 17:55:40,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:40,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:40,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:40,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:40,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-22 17:55:40,700 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-22 17:55:40,700 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:40,700 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-22 17:55:40,700 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-22 17:55:40,701 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:40,701 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:40,704 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:40,704 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:40,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:40,705 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:40,705 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:40,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:40,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-22 17:55:40,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-22 17:55:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-22 17:55:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-22 17:55:40,707 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:40,707 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. started... 2023-03-22 17:55:40,707 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:40,707 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. started... 2023-03-22 17:55:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:40,708 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:40,708 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fabed9683fbe07c602c62c6d810a343b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:40,708 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:40,708 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbb8b34f67283d053be4f901290126d4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:40,708 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. started... 2023-03-22 17:55:40,709 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7710f9558c323b3df8c9bddcf1414c52 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-22 17:55:40,771 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303227e4253e346084f7ca9325554dba920f2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303227e4253e346084f7ca9325554dba920f2 2023-03-22 17:55:41,173 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322f619bb8f8a1c4f688353e7fe25751bb7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322f619bb8f8a1c4f688353e7fe25751bb7 2023-03-22 17:55:41,179 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303222093d80d7f0f412ba63697d7731dac28 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303222093d80d7f0f412ba63697d7731dac28 2023-03-22 17:55:41,187 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/32cc3d6efe144d67a36726ac77369baa 2023-03-22 17:55:41,198 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/c266e4861b7d45959d951e6e3774ee87 2023-03-22 17:55:41,244 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303222f7ce7cdd19d41e1919e3c46be40ecb1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303222f7ce7cdd19d41e1919e3c46be40ecb1 2023-03-22 17:55:41,602 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/7d5b53cdd1f047509d7d03d41d42dfa8 2023-03-22 17:55:41,649 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303226ce9c85b2f6948439bb84c7bcff53e10 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303226ce9c85b2f6948439bb84c7bcff53e10 2023-03-22 17:55:41,649 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322ef30a44b18284d399959ce457eee90b0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230322ef30a44b18284d399959ce457eee90b0 2023-03-22 17:55:41,654 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/87b92498cc834178b15e07352ec5930e 2023-03-22 17:55:41,655 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/e8cdae7b65fd47ae9ad591fa5609bd69 2023-03-22 17:55:41,658 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/32cc3d6efe144d67a36726ac77369baa as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa 2023-03-22 17:55:41,659 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/7d5b53cdd1f047509d7d03d41d42dfa8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8 2023-03-22 17:55:41,685 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa, entries=4, sequenceid=5, filesize=5.5 K 2023-03-22 17:55:41,686 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/87b92498cc834178b15e07352ec5930e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e 2023-03-22 17:55:41,691 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:41,691 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fbb8b34f67283d053be4f901290126d4 in 983ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:41,692 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:41,692 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:41,692 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:41,696 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8, entries=4, sequenceid=5, filesize=5.5 K 2023-03-22 17:55:41,697 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/e8cdae7b65fd47ae9ad591fa5609bd69 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69 2023-03-22 17:55:41,701 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:41,701 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7710f9558c323b3df8c9bddcf1414c52 in 992ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:41,701 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:41,701 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:41,701 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:42,056 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/605c0cd9b1364fd08b592ad330ca8118 2023-03-22 17:55:42,060 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/c266e4861b7d45959d951e6e3774ee87 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87 2023-03-22 17:55:42,085 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87, entries=4, sequenceid=5, filesize=5.5 K 2023-03-22 17:55:42,086 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/605c0cd9b1364fd08b592ad330ca8118 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118 2023-03-22 17:55:42,090 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118, entries=2, sequenceid=5, filesize=5.1 K 2023-03-22 17:55:42,091 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fabed9683fbe07c602c62c6d810a343b in 1383ms, sequenceid=5, compaction requested=false 2023-03-22 17:55:42,091 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:42,091 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-22 17:55:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-22 17:55:42,096 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,097 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:42,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-22 17:55:42,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2016802[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:42,099 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-22 17:55:42,099 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,100 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-22 17:55:42,101 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-22 17:55:42,101 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:42,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,101 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-22 17:55:42,102 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:42,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-22 17:55:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:42,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:42,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-22 17:55:42,106 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-22 17:55:42,106 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:42,106 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:42,106 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-22 17:55:42,106 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:42,108 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,108 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,108 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:42,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:42,109 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,110 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:42,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:42,114 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:42,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:42,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-22 17:55:42,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-22 17:55:42,114 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:42,115 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:42,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:42,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:42,215 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:42,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:42,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:42,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:42,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:42,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:42,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:42,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-22 17:55:42,223 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-22 17:55:42,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:42,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-22 17:55:42,223 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-22 17:55:42,224 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,224 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:42,225 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,225 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:42,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:42,226 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:42,226 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:42,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:42,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-22 17:55:42,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-22 17:55:42,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-22 17:55:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-22 17:55:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. started... 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:42,236 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbb8b34f67283d053be4f901290126d4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:42,236 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:42,236 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. started... 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:42,236 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. started... 2023-03-22 17:55:42,237 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7710f9558c323b3df8c9bddcf1414c52 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:42,236 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fabed9683fbe07c602c62c6d810a343b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-22 17:55:42,304 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032259f3348fd8714f68b83eec0400ffca3f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032259f3348fd8714f68b83eec0400ffca3f 2023-03-22 17:55:42,325 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/68f43ed1f4724022b2abdecfd535e13c 2023-03-22 17:55:42,369 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322e400b421cc5a42488a70883456f44260 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230322e400b421cc5a42488a70883456f44260 2023-03-22 17:55:42,381 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/0241fb16bb694b63a0807d482eb8e39f 2023-03-22 17:55:42,386 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/68f43ed1f4724022b2abdecfd535e13c as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c 2023-03-22 17:55:42,420 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c, entries=4, sequenceid=9, filesize=5.5 K 2023-03-22 17:55:42,421 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/0241fb16bb694b63a0807d482eb8e39f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f 2023-03-22 17:55:42,425 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:42,426 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fabed9683fbe07c602c62c6d810a343b in 190ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:42,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:42,426 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:42,426 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:42,689 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303225bdc717f88044d6088e61b7556388abc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225bdc717f88044d6088e61b7556388abc 2023-03-22 17:55:42,695 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322b5a4695a47014947b698e1fb19ccf20c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b5a4695a47014947b698e1fb19ccf20c 2023-03-22 17:55:42,709 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/1dc0334078d34864bcef614f26b04895 2023-03-22 17:55:43,105 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/bbe8ec1909a246f2b60706912d82f1e7 2023-03-22 17:55:43,140 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303229c64e72f10604db39e875648a8202ba1 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303229c64e72f10604db39e875648a8202ba1 2023-03-22 17:55:43,537 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032273dcfe252f404d55a0d87445ffd077c6 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023032273dcfe252f404d55a0d87445ffd077c6 2023-03-22 17:55:43,544 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f 2023-03-22 17:55:43,547 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/1dc0334078d34864bcef614f26b04895 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895 2023-03-22 17:55:43,570 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895, entries=4, sequenceid=9, filesize=5.5 K 2023-03-22 17:55:43,570 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f 2023-03-22 17:55:43,573 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:43,574 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7710f9558c323b3df8c9bddcf1414c52 in 1337ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:43,574 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:43,574 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:43,942 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/697037dde87f40b18ca2335c6ce7c29b 2023-03-22 17:55:43,946 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/bbe8ec1909a246f2b60706912d82f1e7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7 2023-03-22 17:55:43,968 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7, entries=4, sequenceid=9, filesize=5.5 K 2023-03-22 17:55:43,969 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/697037dde87f40b18ca2335c6ce7c29b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b 2023-03-22 17:55:43,972 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b, entries=2, sequenceid=9, filesize=5.1 K 2023-03-22 17:55:43,972 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fbb8b34f67283d053be4f901290126d4 in 1736ms, sequenceid=9, compaction requested=false 2023-03-22 17:55:43,972 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:43,972 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-22 17:55:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-22 17:55:43,974 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,974 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:43,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:43,974 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,974 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:43,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-22 17:55:43,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27f3dc45[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:43,975 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-22 17:55:43,976 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,977 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-22 17:55:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-22 17:55:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:43,977 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,977 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:43,979 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-22 17:55:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-22 17:55:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:43,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-22 17:55:43,981 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-22 17:55:43,981 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:43,981 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:43,981 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-22 17:55:43,981 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:43,982 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,982 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:43,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,982 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:43,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:43,983 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,984 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,985 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:43,986 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:43,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-22 17:55:43,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:43,986 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:44,086 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:44,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:44,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-22 17:55:44,092 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-22 17:55:44,092 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:44,092 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-22 17:55:44,092 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-22 17:55:44,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:44,093 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:44,094 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:44,094 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:44,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:44,094 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:44,094 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:44,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:44,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-22 17:55:44,095 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-22 17:55:44,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-22 17:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-22 17:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-22 17:55:44,095 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:44,095 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:44,095 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:44,095 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. started... 2023-03-22 17:55:44,095 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:44,096 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. started... 2023-03-22 17:55:44,096 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. started... 2023-03-22 17:55:44,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbb8b34f67283d053be4f901290126d4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:44,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7710f9558c323b3df8c9bddcf1414c52 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:44,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fabed9683fbe07c602c62c6d810a343b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-22 17:55:44,142 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322b348c86816e2401fa189f2417de2dd23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b348c86816e2401fa189f2417de2dd23 2023-03-22 17:55:44,533 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:44,534 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e02167d to 127.0.0.1:60739 2023-03-22 17:55:44,534 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:44,534 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:44,534 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33644fb1 to 127.0.0.1:60739 2023-03-22 17:55:44,534 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:44,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303226107711993ae4bf4b15ed796fd397e85 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303226107711993ae4bf4b15ed796fd397e85 2023-03-22 17:55:44,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322c686fc11885948cdb9534a9df7cebce4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230322c686fc11885948cdb9534a9df7cebce4 2023-03-22 17:55:44,557 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/d9e5600bfe21424986a68ae8cc8f71c8 2023-03-22 17:55:44,588 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/88d7e29dd9c648f5bda7a1d2a3af1f11 2023-03-22 17:55:44,602 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322b3a6df4b0ebe429caf2bb8c4fcdee2aa to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230322b3a6df4b0ebe429caf2bb8c4fcdee2aa 2023-03-22 17:55:44,622 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303220451f3af948d452a93ff530bfb7ae505 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303220451f3af948d452a93ff530bfb7ae505 2023-03-22 17:55:44,628 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/4ca8a648bbe345ae9af753d7ad770780 2023-03-22 17:55:44,631 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/88d7e29dd9c648f5bda7a1d2a3af1f11 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11 2023-03-22 17:55:44,656 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11, entries=4, sequenceid=13, filesize=5.5 K 2023-03-22 17:55:44,656 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/4ca8a648bbe345ae9af753d7ad770780 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780 2023-03-22 17:55:44,659 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:44,660 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fbb8b34f67283d053be4f901290126d4 in 564ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:44,660 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:44,660 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:44,660 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:44,990 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/e8dc4b04335949fcace30b13edc7d72e 2023-03-22 17:55:45,007 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/b6fee916cbc24bf0b2c73e589cb0275b 2023-03-22 17:55:45,011 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/d9e5600bfe21424986a68ae8cc8f71c8 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8 2023-03-22 17:55:45,022 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032261149d9b4af048bcb78be1ddb6dbd689 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023032261149d9b4af048bcb78be1ddb6dbd689 2023-03-22 17:55:45,040 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/eb816f82a8cd4cffbddc4c1906773c5f 2023-03-22 17:55:45,040 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8, entries=4, sequenceid=13, filesize=5.5 K 2023-03-22 17:55:45,040 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/b6fee916cbc24bf0b2c73e589cb0275b as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b 2023-03-22 17:55:45,043 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:45,043 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/e8dc4b04335949fcace30b13edc7d72e as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e 2023-03-22 17:55:45,044 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7710f9558c323b3df8c9bddcf1414c52 in 948ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:45,044 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:45,044 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:45,044 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:45,066 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e, entries=4, sequenceid=13, filesize=5.5 K 2023-03-22 17:55:45,066 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/eb816f82a8cd4cffbddc4c1906773c5f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f 2023-03-22 17:55:45,069 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-22 17:55:45,070 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fabed9683fbe07c602c62c6d810a343b in 974ms, sequenceid=13, compaction requested=true 2023-03-22 17:55:45,070 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:45,070 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-22 17:55:45,071 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-22 17:55:45,072 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:45,072 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-22 17:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c857645[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:45,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-22 17:55:45,074 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,075 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-22 17:55:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-22 17:55:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:45,075 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,075 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:45,077 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-22 17:55:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-22 17:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:45,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-22 17:55:45,079 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-22 17:55:45,079 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:45,079 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:45,079 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-22 17:55:45,079 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:45,081 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,081 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,081 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:45,081 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,082 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:45,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:45,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-22 17:55:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:45,084 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:45,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:45,084 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:45,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:45,085 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,085 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:45,085 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,085 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:45,085 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:45,185 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:45,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:45,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:45,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:45,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-22 17:55:45,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:45,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:45,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-22 17:55:45,191 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-22 17:55:45,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:45,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-22 17:55:45,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-22 17:55:45,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,191 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:45,196 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:45,196 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:45,196 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:45,196 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:45,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:45,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-22 17:55:45,197 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-22 17:55:45,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-22 17:55:45,197 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-22 17:55:45,197 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:45,197 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. started... 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:45,197 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbb8b34f67283d053be4f901290126d4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. started... 2023-03-22 17:55:45,197 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. started... 2023-03-22 17:55:45,197 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:45,198 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fabed9683fbe07c602c62c6d810a343b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:45,198 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:45,198 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7710f9558c323b3df8c9bddcf1414c52 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-22 17:55:45,240 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322d5e3c5a9054f47e4bbe26086cce5209c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322d5e3c5a9054f47e4bbe26086cce5209c 2023-03-22 17:55:45,246 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-22 17:55:45,638 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322e389bc5f333247649c6df420758881ad to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322e389bc5f333247649c6df420758881ad 2023-03-22 17:55:45,642 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303222ef3368059ce48369f6c0390b9c0a6cf to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303222ef3368059ce48369f6c0390b9c0a6cf 2023-03-22 17:55:45,651 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/8d16cc67989c413288ed0035b38093f2 2023-03-22 17:55:45,657 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/077315737f3742ec8f692bd95d3defc0 2023-03-22 17:55:46,065 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/ac0d2a39f49049dfa8ba230ec7745b50 2023-03-22 17:55:46,082 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303221fd79bdc47634a909fa84b2cfe979819 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303221fd79bdc47634a909fa84b2cfe979819 2023-03-22 17:55:46,089 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303224f081aa0598b4d60a294c6be3fcff54a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303224f081aa0598b4d60a294c6be3fcff54a 2023-03-22 17:55:46,096 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303227dabcba3ae104140ade4a8bda27271be to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303227dabcba3ae104140ade4a8bda27271be 2023-03-22 17:55:46,099 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/0867e48b6bf647278a7830353104001f 2023-03-22 17:55:46,102 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/ac0d2a39f49049dfa8ba230ec7745b50 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50 2023-03-22 17:55:46,125 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50, entries=4, sequenceid=17, filesize=5.5 K 2023-03-22 17:55:46,125 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/0867e48b6bf647278a7830353104001f as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f 2023-03-22 17:55:46,128 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:46,129 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fbb8b34f67283d053be4f901290126d4 in 932ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:46,129 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:46,129 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:46,129 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:46,487 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/9460fc89e99e4898b03910d907cd3d67 2023-03-22 17:55:46,491 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/8d16cc67989c413288ed0035b38093f2 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2 2023-03-22 17:55:46,493 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/535708915ca9473497d21a1cc51a14e5 2023-03-22 17:55:46,496 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/077315737f3742ec8f692bd95d3defc0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0 2023-03-22 17:55:46,513 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2, entries=4, sequenceid=17, filesize=5.5 K 2023-03-22 17:55:46,514 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/9460fc89e99e4898b03910d907cd3d67 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67 2023-03-22 17:55:46,517 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:46,518 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fabed9683fbe07c602c62c6d810a343b in 1320ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:46,518 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:46,518 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0, entries=4, sequenceid=17, filesize=5.5 K 2023-03-22 17:55:46,518 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:46,518 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:46,518 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/535708915ca9473497d21a1cc51a14e5 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5 2023-03-22 17:55:46,522 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5, entries=2, sequenceid=17, filesize=5.1 K 2023-03-22 17:55:46,523 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7710f9558c323b3df8c9bddcf1414c52 in 1324ms, sequenceid=17, compaction requested=true 2023-03-22 17:55:46,523 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:46,523 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:46,523 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:46,523 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:46,523 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,523 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-22 17:55:46,523 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-22 17:55:46,524 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,524 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:46,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:46,524 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,525 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:46,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:46,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:46,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:46,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-22 17:55:46,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27500ab[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:46,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-22 17:55:46,526 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,527 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-22 17:55:46,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-22 17:55:46,527 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:46,527 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,527 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:46,528 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-22 17:55:46,528 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,528 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:46,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,528 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-22 17:55:46,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:46,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:46,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:46,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-22 17:55:46,530 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-22 17:55:46,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:46,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:46,530 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-22 17:55:46,530 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:46,532 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,532 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:46,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:46,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,532 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:46,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:46,533 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,534 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:46,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,536 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,536 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:46,536 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:46,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:46,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-22 17:55:46,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:46,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:46,536 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:46,536 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:46,536 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:46,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:46,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:46,537 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,637 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:46,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:46,646 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:46,653 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:46,661 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:46,662 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:46,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-22 17:55:46,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-22 17:55:46,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-22 17:55:46,769 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-22 17:55:46,769 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:46,769 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-22 17:55:46,769 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-22 17:55:46,770 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,770 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:46,771 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:46,771 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:46,771 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:46,771 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-22 17:55:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:46,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-22 17:55:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:46,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-22 17:55:46,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-22 17:55:46,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-22 17:55:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-22 17:55:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-22 17:55:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-22 17:55:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-22 17:55:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. started... 2023-03-22 17:55:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. started... 2023-03-22 17:55:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:46,773 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fbb8b34f67283d053be4f901290126d4 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-22 17:55:46,773 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. started... 2023-03-22 17:55:46,773 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7710f9558c323b3df8c9bddcf1414c52 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:46,773 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fabed9683fbe07c602c62c6d810a343b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-22 17:55:47,212 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/652f76a259364caf83e70f686d30bbf4 2023-03-22 17:55:47,216 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/0e3ebf747c244d3b81260eb7b1b48e16 2023-03-22 17:55:47,234 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 652f76a259364caf83e70f686d30bbf4 2023-03-22 17:55:47,238 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e3ebf747c244d3b81260eb7b1b48e16 2023-03-22 17:55:47,611 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/095ea692e57b4404ad1789e30eb1bd9a 2023-03-22 17:55:47,634 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 095ea692e57b4404ad1789e30eb1bd9a 2023-03-22 17:55:47,645 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/1ed65419a95c471187138b00e5f0c569 2023-03-22 17:55:47,647 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ed65419a95c471187138b00e5f0c569 2023-03-22 17:55:47,648 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/652f76a259364caf83e70f686d30bbf4 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4 2023-03-22 17:55:47,671 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 652f76a259364caf83e70f686d30bbf4 2023-03-22 17:55:47,671 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4, entries=3, sequenceid=23, filesize=5.2 K 2023-03-22 17:55:47,672 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/1ed65419a95c471187138b00e5f0c569 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569 2023-03-22 17:55:47,674 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ed65419a95c471187138b00e5f0c569 2023-03-22 17:55:47,675 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:47,675 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fbb8b34f67283d053be4f901290126d4 in 902ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:47,675 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:47,675 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:47,675 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-22 17:55:48,051 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/9ec9e02575d6432286c52db2664cb460 2023-03-22 17:55:48,054 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ec9e02575d6432286c52db2664cb460 2023-03-22 17:55:48,055 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/0e3ebf747c244d3b81260eb7b1b48e16 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16 2023-03-22 17:55:48,078 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e3ebf747c244d3b81260eb7b1b48e16 2023-03-22 17:55:48,078 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16, entries=3, sequenceid=23, filesize=5.2 K 2023-03-22 17:55:48,078 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/9ec9e02575d6432286c52db2664cb460 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460 2023-03-22 17:55:48,082 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ec9e02575d6432286c52db2664cb460 2023-03-22 17:55:48,082 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:48,083 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7710f9558c323b3df8c9bddcf1414c52 in 1310ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:48,083 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:48,083 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-22 17:55:48,444 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/97aae9cf5e39442e9b940f4dd33bae83 2023-03-22 17:55:48,447 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97aae9cf5e39442e9b940f4dd33bae83 2023-03-22 17:55:48,448 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/095ea692e57b4404ad1789e30eb1bd9a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a 2023-03-22 17:55:48,470 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 095ea692e57b4404ad1789e30eb1bd9a 2023-03-22 17:55:48,470 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a, entries=3, sequenceid=23, filesize=5.2 K 2023-03-22 17:55:48,471 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/97aae9cf5e39442e9b940f4dd33bae83 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83 2023-03-22 17:55:48,474 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97aae9cf5e39442e9b940f4dd33bae83 2023-03-22 17:55:48,474 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83, entries=1, sequenceid=23, filesize=5.0 K 2023-03-22 17:55:48,474 INFO [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fabed9683fbe07c602c62c6d810a343b in 1701ms, sequenceid=23, compaction requested=true 2023-03-22 17:55:48,474 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:48,474 DEBUG [rs(jenkins-hbase4.apache.org,46619,1679507617635)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-22 17:55:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-22 17:55:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-22 17:55:48,475 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-22 17:55:48,476 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,476 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:48,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:48,476 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,476 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-22 17:55:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:48,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46619,1679507617635' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-22 17:55:48,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bbd399f[Count = 0] remaining members to acquire global barrier 2023-03-22 17:55:48,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-22 17:55:48,478 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,480 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-22 17:55:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-22 17:55:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46619,1679507617635' in zk 2023-03-22 17:55:48,480 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,481 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-22 17:55:48,482 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-22 17:55:48,482 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:48,482 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,482 DEBUG [member: 'jenkins-hbase4.apache.org,46619,1679507617635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-22 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:48,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46619,1679507617635': 2023-03-22 17:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46619,1679507617635' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-22 17:55:48,484 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-22 17:55:48,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-22 17:55:48,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-22 17:55:48,484 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-22 17:55:48,484 INFO [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-22 17:55:48,486 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,486 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-22 17:55:48,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,486 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-22 17:55:48,486 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:48,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-22 17:55:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,487 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-22 17:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-22 17:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:48,489 DEBUG [(jenkins-hbase4.apache.org,40261,1679507616391)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-22 17:55:48,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-22 17:55:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-22 17:55:48,489 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:48,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-22 17:55:48,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-22 17:55:48,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-22 17:55:48,490 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-22 17:55:48,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-22 17:55:48,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-22 17:55:48,490 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-22 17:55:48,490 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-22 17:55:48,590 DEBUG [Listener at localhost/34365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-22 17:55:48,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40261] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-22 17:55:48,591 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:48,592 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): fbb8b34f67283d053be4f901290126d4/family1 is initiating major compaction (all files) 2023-03-22 17:55:48,592 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:48,592 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:48,592 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of fbb8b34f67283d053be4f901290126d4/family1 in testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:48,592 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp, totalSize=27.1 K 2023-03-22 17:55:48,593 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 32cc3d6efe144d67a36726ac77369baa, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740695 2023-03-22 17:55:48,593 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting bbe8ec1909a246f2b60706912d82f1e7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:48,593 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 88d7e29dd9c648f5bda7a1d2a3af1f11, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:48,594 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting ac0d2a39f49049dfa8ba230ec7745b50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:48,594 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 652f76a259364caf83e70f686d30bbf4, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:48,602 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): fbb8b34f67283d053be4f901290126d4#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:49,038 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del 2023-03-22 17:55:49,038 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del 2023-03-22 17:55:49,889 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c128d3f526aa44699582098c00d97439 2023-03-22 17:55:49,889 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family1/c128d3f526aa44699582098c00d97439 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/c128d3f526aa44699582098c00d97439 2023-03-22 17:55:49,912 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c128d3f526aa44699582098c00d97439 2023-03-22 17:55:49,913 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fbb8b34f67283d053be4f901290126d4/family1 of fbb8b34f67283d053be4f901290126d4 into c128d3f526aa44699582098c00d97439(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:49,913 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:49,913 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:49,913 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): fbb8b34f67283d053be4f901290126d4/family2 is initiating major compaction (all files) 2023-03-22 17:55:49,913 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:49,913 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:49,913 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of fbb8b34f67283d053be4f901290126d4/family2 in testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:49,913 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp, totalSize=25.4 K 2023-03-22 17:55:49,914 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 87b92498cc834178b15e07352ec5930e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740695 2023-03-22 17:55:49,914 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 697037dde87f40b18ca2335c6ce7c29b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:49,914 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 4ca8a648bbe345ae9af753d7ad770780, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:49,915 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 0867e48b6bf647278a7830353104001f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:49,915 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 1ed65419a95c471187138b00e5f0c569, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:49,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4] to archive 2023-03-22 17:55:49,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:49,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/32cc3d6efe144d67a36726ac77369baa 2023-03-22 17:55:49,922 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): fbb8b34f67283d053be4f901290126d4#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:49,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/bbe8ec1909a246f2b60706912d82f1e7 2023-03-22 17:55:49,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/88d7e29dd9c648f5bda7a1d2a3af1f11 2023-03-22 17:55:49,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/ac0d2a39f49049dfa8ba230ec7745b50 2023-03-22 17:55:49,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/652f76a259364caf83e70f686d30bbf4 2023-03-22 17:55:50,334 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230322ee8e6b9287d4496aa6a6cd224330df6c_del 2023-03-22 17:55:50,334 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322ee8e6b9287d4496aa6a6cd224330df6c_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230322ee8e6b9287d4496aa6a6cd224330df6c_del 2023-03-22 17:55:51,145 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa9fcc9d767b437ea3b6de81de5f7415 2023-03-22 17:55:51,146 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/.tmp/family2/fa9fcc9d767b437ea3b6de81de5f7415 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/fa9fcc9d767b437ea3b6de81de5f7415 2023-03-22 17:55:51,148 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa9fcc9d767b437ea3b6de81de5f7415 2023-03-22 17:55:51,149 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fbb8b34f67283d053be4f901290126d4/family2 of fbb8b34f67283d053be4f901290126d4 into fa9fcc9d767b437ea3b6de81de5f7415(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:51,150 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:51,150 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:51,150 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): fabed9683fbe07c602c62c6d810a343b/family1 is initiating major compaction (all files) 2023-03-22 17:55:51,150 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:51,150 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:51,151 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of fabed9683fbe07c602c62c6d810a343b/family1 in testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:51,151 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp, totalSize=27.1 K 2023-03-22 17:55:51,151 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting c266e4861b7d45959d951e6e3774ee87, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740694 2023-03-22 17:55:51,152 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 68f43ed1f4724022b2abdecfd535e13c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:51,152 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e8dc4b04335949fcace30b13edc7d72e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:51,152 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 8d16cc67989c413288ed0035b38093f2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:51,152 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 095ea692e57b4404ad1789e30eb1bd9a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:51,159 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): fabed9683fbe07c602c62c6d810a343b#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:51,195 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del 2023-03-22 17:55:51,195 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del 2023-03-22 17:55:51,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569] to archive 2023-03-22 17:55:51,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:51,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/87b92498cc834178b15e07352ec5930e 2023-03-22 17:55:51,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/697037dde87f40b18ca2335c6ce7c29b 2023-03-22 17:55:51,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/4ca8a648bbe345ae9af753d7ad770780 2023-03-22 17:55:51,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/0867e48b6bf647278a7830353104001f 2023-03-22 17:55:51,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family2/1ed65419a95c471187138b00e5f0c569 2023-03-22 17:55:52,049 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8923c560c048433284ac6548ddc3d023 2023-03-22 17:55:52,050 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family1/8923c560c048433284ac6548ddc3d023 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8923c560c048433284ac6548ddc3d023 2023-03-22 17:55:52,072 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8923c560c048433284ac6548ddc3d023 2023-03-22 17:55:52,072 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fabed9683fbe07c602c62c6d810a343b/family1 of fabed9683fbe07c602c62c6d810a343b into 8923c560c048433284ac6548ddc3d023(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:52,073 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:52,073 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:52,073 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): fabed9683fbe07c602c62c6d810a343b/family2 is initiating major compaction (all files) 2023-03-22 17:55:52,073 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:52,073 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:52,073 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of fabed9683fbe07c602c62c6d810a343b/family2 in testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:52,073 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp, totalSize=25.4 K 2023-03-22 17:55:52,074 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 605c0cd9b1364fd08b592ad330ca8118, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740694 2023-03-22 17:55:52,074 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 0241fb16bb694b63a0807d482eb8e39f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:52,074 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting eb816f82a8cd4cffbddc4c1906773c5f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:52,075 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 9460fc89e99e4898b03910d907cd3d67, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:52,075 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 97aae9cf5e39442e9b940f4dd33bae83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:52,082 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): fabed9683fbe07c602c62c6d810a343b#family2#compaction#200 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:52,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a] to archive 2023-03-22 17:55:52,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:52,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/c266e4861b7d45959d951e6e3774ee87 2023-03-22 17:55:52,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/68f43ed1f4724022b2abdecfd535e13c 2023-03-22 17:55:52,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/e8dc4b04335949fcace30b13edc7d72e 2023-03-22 17:55:52,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/8d16cc67989c413288ed0035b38093f2 2023-03-22 17:55:52,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/095ea692e57b4404ad1789e30eb1bd9a 2023-03-22 17:55:52,490 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032240f40c83d84d4c2e909989757b16a837_del 2023-03-22 17:55:52,490 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032240f40c83d84d4c2e909989757b16a837_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023032240f40c83d84d4c2e909989757b16a837_del 2023-03-22 17:55:53,302 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c769344e5554568a8423508efd4b2a3 2023-03-22 17:55:53,303 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/.tmp/family2/9c769344e5554568a8423508efd4b2a3 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9c769344e5554568a8423508efd4b2a3 2023-03-22 17:55:53,305 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c769344e5554568a8423508efd4b2a3 2023-03-22 17:55:53,306 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fabed9683fbe07c602c62c6d810a343b/family2 of fabed9683fbe07c602c62c6d810a343b into 9c769344e5554568a8423508efd4b2a3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:53,306 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:53,306 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:53,307 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 7710f9558c323b3df8c9bddcf1414c52/family1 is initiating major compaction (all files) 2023-03-22 17:55:53,307 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:53,307 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:53,307 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 7710f9558c323b3df8c9bddcf1414c52/family1 in testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:53,307 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp, totalSize=27.1 K 2023-03-22 17:55:53,307 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 7d5b53cdd1f047509d7d03d41d42dfa8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740695 2023-03-22 17:55:53,308 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 1dc0334078d34864bcef614f26b04895, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:53,308 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting d9e5600bfe21424986a68ae8cc8f71c8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:53,308 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 077315737f3742ec8f692bd95d3defc0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:53,308 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 0e3ebf747c244d3b81260eb7b1b48e16, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:53,316 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 7710f9558c323b3df8c9bddcf1414c52#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:53,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83] to archive 2023-03-22 17:55:53,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:53,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/605c0cd9b1364fd08b592ad330ca8118 2023-03-22 17:55:53,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/0241fb16bb694b63a0807d482eb8e39f 2023-03-22 17:55:53,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/eb816f82a8cd4cffbddc4c1906773c5f 2023-03-22 17:55:53,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/9460fc89e99e4898b03910d907cd3d67 2023-03-22 17:55:53,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family2/97aae9cf5e39442e9b940f4dd33bae83 2023-03-22 17:55:53,769 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del 2023-03-22 17:55:53,769 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del 2023-03-22 17:55:53,824 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47e760db376c401695b34ea3fa31f6ec 2023-03-22 17:55:53,825 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family1/47e760db376c401695b34ea3fa31f6ec as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/47e760db376c401695b34ea3fa31f6ec 2023-03-22 17:55:53,853 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47e760db376c401695b34ea3fa31f6ec 2023-03-22 17:55:53,855 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7710f9558c323b3df8c9bddcf1414c52/family1 of 7710f9558c323b3df8c9bddcf1414c52 into 47e760db376c401695b34ea3fa31f6ec(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-22 17:55:53,855 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:53,855 DEBUG [Listener at localhost/34365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-22 17:55:53,855 DEBUG [Listener at localhost/34365] regionserver.HStore(1912): 7710f9558c323b3df8c9bddcf1414c52/family2 is initiating major compaction (all files) 2023-03-22 17:55:53,855 INFO [Listener at localhost/34365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-22 17:55:53,855 INFO [Listener at localhost/34365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-22 17:55:53,856 INFO [Listener at localhost/34365] regionserver.HRegion(2259): Starting compaction of 7710f9558c323b3df8c9bddcf1414c52/family2 in testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:53,856 INFO [Listener at localhost/34365] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460] into tmpdir=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp, totalSize=25.4 K 2023-03-22 17:55:53,856 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting e8cdae7b65fd47ae9ad591fa5609bd69, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679507740695 2023-03-22 17:55:53,857 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 0a2c2c40c6ba459597cbbd6d3fb49b9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679507742217 2023-03-22 17:55:53,857 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting b6fee916cbc24bf0b2c73e589cb0275b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679507744088 2023-03-22 17:55:53,857 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 535708915ca9473497d21a1cc51a14e5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679507745187 2023-03-22 17:55:53,858 DEBUG [Listener at localhost/34365] compactions.Compactor(207): Compacting 9ec9e02575d6432286c52db2664cb460, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-22 17:55:53,872 INFO [Listener at localhost/34365] throttle.PressureAwareThroughputController(145): 7710f9558c323b3df8c9bddcf1414c52#family2#compaction#202 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-22 17:55:53,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16] to archive 2023-03-22 17:55:53,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:53,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/7d5b53cdd1f047509d7d03d41d42dfa8 2023-03-22 17:55:53,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/1dc0334078d34864bcef614f26b04895 2023-03-22 17:55:53,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/d9e5600bfe21424986a68ae8cc8f71c8 2023-03-22 17:55:53,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/077315737f3742ec8f692bd95d3defc0 2023-03-22 17:55:53,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/0e3ebf747c244d3b81260eb7b1b48e16 2023-03-22 17:55:54,291 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023032289dbc94452ad4d739242bd700982c0c2_del 2023-03-22 17:55:54,291 INFO [Listener at localhost/34365] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032289dbc94452ad4d739242bd700982c0c2_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023032289dbc94452ad4d739242bd700982c0c2_del 2023-03-22 17:55:55,105 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c94b2d31fe72435f95371003fb845f66 2023-03-22 17:55:55,106 DEBUG [Listener at localhost/34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/.tmp/family2/c94b2d31fe72435f95371003fb845f66 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/c94b2d31fe72435f95371003fb845f66 2023-03-22 17:55:55,109 INFO [Listener at localhost/34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c94b2d31fe72435f95371003fb845f66 2023-03-22 17:55:55,110 INFO [Listener at localhost/34365] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7710f9558c323b3df8c9bddcf1414c52/family2 of 7710f9558c323b3df8c9bddcf1414c52 into c94b2d31fe72435f95371003fb845f66(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-22 17:55:55,110 DEBUG [Listener at localhost/34365] regionserver.HRegion(2289): Compaction status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:55,113 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:55,116 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:55,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460] to archive 2023-03-22 17:55:55,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:55,122 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:55,123 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:55,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/e8cdae7b65fd47ae9ad591fa5609bd69 2023-03-22 17:55:55,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/0a2c2c40c6ba459597cbbd6d3fb49b9f 2023-03-22 17:55:55,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/b6fee916cbc24bf0b2c73e589cb0275b 2023-03-22 17:55:55,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/535708915ca9473497d21a1cc51a14e5 2023-03-22 17:55:55,131 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40261] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x102\xDA\xB2\x8D\xFA*W\xB4\x1F=\xF17:\xAB\x5C\xE5"\x10#\xC6\xF3\x8C\x12I\x11\xC3:\xEC\xB9\xF9\xB5\xD9\x06\x1E*\x10\x19\x18\x7F.\xFC\xC3~~>=\x5C\xBD\xD2*k\x912\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-22 17:55:55,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family2/9ec9e02575d6432286c52db2664cb460 2023-03-22 17:55:55,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-22 17:55:55,157 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-22 17:55:55,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:55:55,158 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679508355158 2023-03-22 17:55:55,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-22 17:55:55,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-22 17:55:55,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del 2023-03-22 17:55:55,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del 2023-03-22 17:55:55,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del 2023-03-22 17:55:55,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:55,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] zookeeper.ReadOnlyZKClient(139): Connect 0x7c6ffc26 to 127.0.0.1:60739 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-22 17:55:55,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7acf10a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-22 17:55:55,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:55,938 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032210a1c6a6184a488198f04114ed773065 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023032210a1c6a6184a488198f04114ed773065 2023-03-22 17:55:55,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:55,957 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-22 17:55:55,959 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39694, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-22 17:55:55,973 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-22 17:55:55,976 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-22 17:55:56,025 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230322/family1/9a86686dc3214625af1c586a27e714f7 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-22 17:55:56,029 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230322/family1/9a86686dc3214625af1c586a27e714f7}] 2023-03-22 17:55:56,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230322/family1/9a86686dc3214625af1c586a27e714f7 for inclusion in 7710f9558c323b3df8c9bddcf1414c52/family1 2023-03-22 17:55:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-22 17:55:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-22 17:55:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:56,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230322/family1/9a86686dc3214625af1c586a27e714f7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__f8bg46nmh70pfpj2f8441n9rocdruc8p2ei48op8je8l0hnmtbn1271jn3hvf6nk/family1/9a86686dc3214625af1c586a27e714f7 2023-03-22 17:55:56,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__f8bg46nmh70pfpj2f8441n9rocdruc8p2ei48op8je8l0hnmtbn1271jn3hvf6nk/family1/9a86686dc3214625af1c586a27e714f7 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/a09209bd71684ebf88cbd4e046888d51_SeqId_28_ 2023-03-22 17:55:56,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__f8bg46nmh70pfpj2f8441n9rocdruc8p2ei48op8je8l0hnmtbn1271jn3hvf6nk/family1/9a86686dc3214625af1c586a27e714f7 into 7710f9558c323b3df8c9bddcf1414c52/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/a09209bd71684ebf88cbd4e046888d51_SeqId_28_ - updating store file list. 2023-03-22 17:55:56,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/a09209bd71684ebf88cbd4e046888d51_SeqId_28_ into 7710f9558c323b3df8c9bddcf1414c52/family1 2023-03-22 17:55:56,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__f8bg46nmh70pfpj2f8441n9rocdruc8p2ei48op8je8l0hnmtbn1271jn3hvf6nk/family1/9a86686dc3214625af1c586a27e714f7 into 7710f9558c323b3df8c9bddcf1414c52/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/family1/a09209bd71684ebf88cbd4e046888d51_SeqId_28_) 2023-03-22 17:55:56,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__f8bg46nmh70pfpj2f8441n9rocdruc8p2ei48op8je8l0hnmtbn1271jn3hvf6nk/family1/9a86686dc3214625af1c586a27e714f7 2023-03-22 17:55:56,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:56,141 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:56,142 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303222093d80d7f0f412ba63697d7731dac28 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303222093d80d7f0f412ba63697d7731dac28 2023-03-22 17:55:56,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b348c86816e2401fa189f2417de2dd23 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b348c86816e2401fa189f2417de2dd23 2023-03-22 17:55:56,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b5a4695a47014947b698e1fb19ccf20c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322b5a4695a47014947b698e1fb19ccf20c 2023-03-22 17:55:56,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322d5e3c5a9054f47e4bbe26086cce5209c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322d5e3c5a9054f47e4bbe26086cce5209c 2023-03-22 17:55:56,147 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-22 17:55:56,147 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230322' 2023-03-22 17:55:56,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:56,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:56,796 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230322a681be8235b543f7ace0ae6cee9e612b to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230322a681be8235b543f7ace0ae6cee9e612b 2023-03-22 17:55:56,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:56,852 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230322/family1/958e61a1127542b5aa23a9f20899adc9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-22 17:55:56,852 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230322/family1/958e61a1127542b5aa23a9f20899adc9}] 2023-03-22 17:55:56,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230322/family1/958e61a1127542b5aa23a9f20899adc9 for inclusion in fbb8b34f67283d053be4f901290126d4/family1 2023-03-22 17:55:56,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-22 17:55:56,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-22 17:55:56,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:56,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230322/family1/958e61a1127542b5aa23a9f20899adc9 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__ihst11eve0rfeo86fkgaqjdlq9bqboa2fheov4h2ev4lki9ljengfgvbbggtap6p/family1/958e61a1127542b5aa23a9f20899adc9 2023-03-22 17:55:56,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__ihst11eve0rfeo86fkgaqjdlq9bqboa2fheov4h2ev4lki9ljengfgvbbggtap6p/family1/958e61a1127542b5aa23a9f20899adc9 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/73ade54e21354c9c8d3d7e5329b85ed0_SeqId_28_ 2023-03-22 17:55:56,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__ihst11eve0rfeo86fkgaqjdlq9bqboa2fheov4h2ev4lki9ljengfgvbbggtap6p/family1/958e61a1127542b5aa23a9f20899adc9 into fbb8b34f67283d053be4f901290126d4/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/73ade54e21354c9c8d3d7e5329b85ed0_SeqId_28_ - updating store file list. 2023-03-22 17:55:56,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/73ade54e21354c9c8d3d7e5329b85ed0_SeqId_28_ into fbb8b34f67283d053be4f901290126d4/family1 2023-03-22 17:55:56,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__ihst11eve0rfeo86fkgaqjdlq9bqboa2fheov4h2ev4lki9ljengfgvbbggtap6p/family1/958e61a1127542b5aa23a9f20899adc9 into fbb8b34f67283d053be4f901290126d4/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/family1/73ade54e21354c9c8d3d7e5329b85ed0_SeqId_28_) 2023-03-22 17:55:56,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__ihst11eve0rfeo86fkgaqjdlq9bqboa2fheov4h2ev4lki9ljengfgvbbggtap6p/family1/958e61a1127542b5aa23a9f20899adc9 2023-03-22 17:55:56,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:56,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:56,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303222ef3368059ce48369f6c0390b9c0a6cf to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303222ef3368059ce48369f6c0390b9c0a6cf 2023-03-22 17:55:56,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225bdc717f88044d6088e61b7556388abc to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225bdc717f88044d6088e61b7556388abc 2023-03-22 17:55:56,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303227e4253e346084f7ca9325554dba920f2 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303227e4253e346084f7ca9325554dba920f2 2023-03-22 17:55:56,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230322c686fc11885948cdb9534a9df7cebce4 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230322c686fc11885948cdb9534a9df7cebce4 2023-03-22 17:55:56,925 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-22 17:55:56,925 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230322' 2023-03-22 17:55:56,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:56,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:57,517 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303226cbfd5349f1944d68cff8b707e2dbe2c to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303226cbfd5349f1944d68cff8b707e2dbe2c 2023-03-22 17:55:57,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:57,560 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230322/family1/3d02462e35724809b32843d130301d25 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-22 17:55:57,561 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b., hostname=jenkins-hbase4.apache.org,46619,1679507617635, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230322/family1/3d02462e35724809b32843d130301d25}] 2023-03-22 17:55:57,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(763): Validating hfile at hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230322/family1/3d02462e35724809b32843d130301d25 for inclusion in fabed9683fbe07c602c62c6d810a343b/family1 2023-03-22 17:55:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-22 17:55:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(777): Region bounds: first= last=1 2023-03-22 17:55:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegion(2446): Flush status journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:57,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230322/family1/3d02462e35724809b32843d130301d25 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__5t4nk0oqpjtu7p88pd2fg9m73lh4drgmqa2vlar3di8hcjgf14kdbe1o52j8vrjk/family1/3d02462e35724809b32843d130301d25 2023-03-22 17:55:57,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__5t4nk0oqpjtu7p88pd2fg9m73lh4drgmqa2vlar3di8hcjgf14kdbe1o52j8vrjk/family1/3d02462e35724809b32843d130301d25 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/5205d1fbbaf64623ac0a9da1584fa7f1_SeqId_28_ 2023-03-22 17:55:57,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(849): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__5t4nk0oqpjtu7p88pd2fg9m73lh4drgmqa2vlar3di8hcjgf14kdbe1o52j8vrjk/family1/3d02462e35724809b32843d130301d25 into fabed9683fbe07c602c62c6d810a343b/family1 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/5205d1fbbaf64623ac0a9da1584fa7f1_SeqId_28_ - updating store file list. 2023-03-22 17:55:57,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(882): Loaded HFile hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/5205d1fbbaf64623ac0a9da1584fa7f1_SeqId_28_ into fabed9683fbe07c602c62c6d810a343b/family1 2023-03-22 17:55:57,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.HStore(855): Successfully loaded hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__5t4nk0oqpjtu7p88pd2fg9m73lh4drgmqa2vlar3di8hcjgf14kdbe1o52j8vrjk/family1/3d02462e35724809b32843d130301d25 into fabed9683fbe07c602c62c6d810a343b/family1 (new location: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/family1/5205d1fbbaf64623ac0a9da1584fa7f1_SeqId_28_) 2023-03-22 17:55:57,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46619] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/staging/jenkins__testMajorCompactionFromAdmin__5t4nk0oqpjtu7p88pd2fg9m73lh4drgmqa2vlar3di8hcjgf14kdbe1o52j8vrjk/family1/3d02462e35724809b32843d130301d25 2023-03-22 17:55:57,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230322 table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:57,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:57,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032259f3348fd8714f68b83eec0400ffca3f to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032259f3348fd8714f68b83eec0400ffca3f 2023-03-22 17:55:57,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303226107711993ae4bf4b15ed796fd397e85 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303226107711993ae4bf4b15ed796fd397e85 2023-03-22 17:55:57,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322e389bc5f333247649c6df420758881ad to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322e389bc5f333247649c6df420758881ad 2023-03-22 17:55:57,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322f619bb8f8a1c4f688353e7fe25751bb7 to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322f619bb8f8a1c4f688353e7fe25751bb7 2023-03-22 17:55:57,643 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-22 17:55:57,643 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230322' 2023-03-22 17:55:57,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230322 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:57,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-22 17:55:57,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-22 17:55:57,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del] 2023-03-22 17:55:57,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:57,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230322829b9bd6c8654cc0810c2013006f92ae_del 2023-03-22 17:55:57,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-22 17:55:57,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del] 2023-03-22 17:55:57,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:57,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230322cf1f62afbbcf4e18b346963f191e03b5_del 2023-03-22 17:55:57,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-22 17:55:57,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del] 2023-03-22 17:55:57,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(360): Archiving compacted files. 2023-03-22 17:55:57,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del to hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303225948763411e74776885563cdcec81ec2_del 2023-03-22 17:55:57,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-22 17:55:57,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679507621476] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-22 17:55:57,650 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-22 17:55:57,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4950 sec 2023-03-22 17:55:57,664 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:57,666 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:57,670 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-22 17:55:57,671 DEBUG [Listener at localhost/34365] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-22 17:55:57,678 INFO [Listener at localhost/34365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-22 17:55:57,745 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:57,748 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c6ffc26 to 127.0.0.1:60739 2023-03-22 17:55:57,748 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:57,761 INFO [Listener at localhost/34365] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 259), OpenFileDescriptor=638 (was 662), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 342), ProcessCount=169 (was 169), AvailableMemoryMB=5835 (was 5834) - AvailableMemoryMB LEAK? - 2023-03-22 17:55:57,762 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b586bb5 to 127.0.0.1:60739 2023-03-22 17:55:57,762 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:57,762 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-22 17:55:57,762 INFO [Listener at localhost/34365] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-22 17:55:57,762 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x561bf69b to 127.0.0.1:60739 2023-03-22 17:55:57,762 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:57,763 DEBUG [Listener at localhost/34365] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-22 17:55:57,763 DEBUG [Listener at localhost/34365] util.JVMClusterUtil(257): Found active master hash=599010081, stopped=false 2023-03-22 17:55:57,763 INFO [Listener at localhost/34365] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:55:57,764 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-22 17:55:57,764 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-22 17:55:57,764 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:55:57,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-22 17:55:57,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-22 17:55:57,769 INFO [Listener at localhost/34365] procedure2.ProcedureExecutor(629): Stopping 2023-03-22 17:55:57,769 DEBUG [Listener at localhost/34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x222930dc to 127.0.0.1:60739 2023-03-22 17:55:57,769 DEBUG [Listener at localhost/34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:57,769 INFO [Listener at localhost/34365] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46619,1679507617635' ***** 2023-03-22 17:55:57,769 INFO [Listener at localhost/34365] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-22 17:55:57,770 INFO [RS:0;jenkins-hbase4:46619] regionserver.HeapMemoryManager(220): Stopping 2023-03-22 17:55:57,770 INFO [RS:0;jenkins-hbase4:46619] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-22 17:55:57,770 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-22 17:55:57,770 INFO [RS:0;jenkins-hbase4:46619] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-22 17:55:57,770 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 92f6a8c69f04feb2c2e2175aa2fcf487 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 546a55e513840caf9aef078505d378c5 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 7eaae50c2de027d9af0c25b2dce0ffdc 2023-03-22 17:55:57,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92f6a8c69f04feb2c2e2175aa2fcf487, disabling compactions & flushes 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for fbb8b34f67283d053be4f901290126d4 2023-03-22 17:55:57,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for fabed9683fbe07c602c62c6d810a343b 2023-03-22 17:55:57,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:55:57,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. after waiting 0 ms 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 6aab306289443dd1ebc37d2169a12d8f 2023-03-22 17:55:57,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for dfab92a478307e4a572bc8d39b8084fd 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for ea758f8595ac567ffe84ee13d88907de 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 784eca6306992fa6c06378bcbb05395c 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for fde19d3a3b3c0cf9a44bc6d567be31f2 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 6bf4ad76645cab3c5938606f0a9ae870 2023-03-22 17:55:57,771 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for ef607e06cf69000c37dd9f95ef6d924a 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for b5f1ba5448b3f743247bcb076351a8be 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 72d334bfaccf92d12e3cc29b15536ea4 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 8bfb56d80101d7d405037a15c1758d60 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 62875c1cb9dc4a5947ba040718dc77cc 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 34b5c9c5b6abd41e9a7d80e152ae4896 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 7710f9558c323b3df8c9bddcf1414c52 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:57,772 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:57,772 DEBUG [RS:0;jenkins-hbase4:46619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ff98d89 to 127.0.0.1:60739 2023-03-22 17:55:57,772 DEBUG [RS:0;jenkins-hbase4:46619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:57,773 INFO [RS:0;jenkins-hbase4:46619] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-22 17:55:57,773 INFO [RS:0;jenkins-hbase4:46619] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-22 17:55:57,773 INFO [RS:0;jenkins-hbase4:46619] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-22 17:55:57,773 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-22 17:55:57,773 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-22 17:55:57,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-22 17:55:57,773 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-22 17:55:57,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-22 17:55:57,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-22 17:55:57,773 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-22 17:55:57,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-22 17:55:57,774 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1505): Waiting on 1588230740, 34b5c9c5b6abd41e9a7d80e152ae4896, 546a55e513840caf9aef078505d378c5, 62875c1cb9dc4a5947ba040718dc77cc, 6aab306289443dd1ebc37d2169a12d8f, 6bf4ad76645cab3c5938606f0a9ae870, 72d334bfaccf92d12e3cc29b15536ea4, 7710f9558c323b3df8c9bddcf1414c52, 784eca6306992fa6c06378bcbb05395c, 7eaae50c2de027d9af0c25b2dce0ffdc, 8bfb56d80101d7d405037a15c1758d60, 92f6a8c69f04feb2c2e2175aa2fcf487, b5f1ba5448b3f743247bcb076351a8be, d5724222967b26b81b2994ecd84a2482, dfab92a478307e4a572bc8d39b8084fd, ea758f8595ac567ffe84ee13d88907de, ef607e06cf69000c37dd9f95ef6d924a, fabed9683fbe07c602c62c6d810a343b, fbb8b34f67283d053be4f901290126d4, fde19d3a3b3c0cf9a44bc6d567be31f2, fe4a473101b583b428ed5bab81ae9d1e 2023-03-22 17:55:57,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithWeeklyPolicy/92f6a8c69f04feb2c2e2175aa2fcf487/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-22 17:55:57,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92f6a8c69f04feb2c2e2175aa2fcf487: 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1679507640708.92f6a8c69f04feb2c2e2175aa2fcf487. 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 546a55e513840caf9aef078505d378c5, disabling compactions & flushes 2023-03-22 17:55:57,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. after waiting 0 ms 2023-03-22 17:55:57,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:57,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/546a55e513840caf9aef078505d378c5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-22 17:55:57,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:57,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 546a55e513840caf9aef078505d378c5: 2023-03-22 17:55:57,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1679507692472.546a55e513840caf9aef078505d378c5. 2023-03-22 17:55:57,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7eaae50c2de027d9af0c25b2dce0ffdc, disabling compactions & flushes 2023-03-22 17:55:57,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:55:57,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:55:57,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. after waiting 0 ms 2023-03-22 17:55:57,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:55:57,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7eaae50c2de027d9af0c25b2dce0ffdc/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-22 17:55:57,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:55:57,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7eaae50c2de027d9af0c25b2dce0ffdc: 2023-03-22 17:55:57,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679507664920.7eaae50c2de027d9af0c25b2dce0ffdc. 2023-03-22 17:55:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fbb8b34f67283d053be4f901290126d4, disabling compactions & flushes 2023-03-22 17:55:57,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. after waiting 0 ms 2023-03-22 17:55:57,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:57,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fbb8b34f67283d053be4f901290126d4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:57,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fbb8b34f67283d053be4f901290126d4: 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1679507738546.fbb8b34f67283d053be4f901290126d4. 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fabed9683fbe07c602c62c6d810a343b, disabling compactions & flushes 2023-03-22 17:55:57,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. after waiting 0 ms 2023-03-22 17:55:57,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:57,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/fabed9683fbe07c602c62c6d810a343b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:57,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fabed9683fbe07c602c62c6d810a343b: 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1679507738546.fabed9683fbe07c602c62c6d810a343b. 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe4a473101b583b428ed5bab81ae9d1e, disabling compactions & flushes 2023-03-22 17:55:57,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. after waiting 0 ms 2023-03-22 17:55:57,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:55:57,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/fe4a473101b583b428ed5bab81ae9d1e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-22 17:55:57,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe4a473101b583b428ed5bab81ae9d1e: 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1679507651438.fe4a473101b583b428ed5bab81ae9d1e. 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6aab306289443dd1ebc37d2169a12d8f, disabling compactions & flushes 2023-03-22 17:55:57,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. after waiting 0 ms 2023-03-22 17:55:57,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:55:57,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6aab306289443dd1ebc37d2169a12d8f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-22 17:55:57,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:55:57,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6aab306289443dd1ebc37d2169a12d8f: 2023-03-22 17:55:57,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679507621616.6aab306289443dd1ebc37d2169a12d8f. 2023-03-22 17:55:57,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dfab92a478307e4a572bc8d39b8084fd, disabling compactions & flushes 2023-03-22 17:55:57,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. after waiting 0 ms 2023-03-22 17:55:57,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:57,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/dfab92a478307e4a572bc8d39b8084fd/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:57,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dfab92a478307e4a572bc8d39b8084fd: 2023-03-22 17:55:57,822 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1679507712304.dfab92a478307e4a572bc8d39b8084fd. 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea758f8595ac567ffe84ee13d88907de, disabling compactions & flushes 2023-03-22 17:55:57,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. after waiting 0 ms 2023-03-22 17:55:57,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:57,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/ea758f8595ac567ffe84ee13d88907de/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:57,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea758f8595ac567ffe84ee13d88907de: 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1679507712304.ea758f8595ac567ffe84ee13d88907de. 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 784eca6306992fa6c06378bcbb05395c, disabling compactions & flushes 2023-03-22 17:55:57,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. after waiting 0 ms 2023-03-22 17:55:57,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:55:57,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithMonthlyPolicy/784eca6306992fa6c06378bcbb05395c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-22 17:55:57,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 784eca6306992fa6c06378bcbb05395c: 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1679507632763.784eca6306992fa6c06378bcbb05395c. 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fde19d3a3b3c0cf9a44bc6d567be31f2, disabling compactions & flushes 2023-03-22 17:55:57,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. after waiting 0 ms 2023-03-22 17:55:57,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:55:57,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fde19d3a3b3c0cf9a44bc6d567be31f2/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-22 17:55:57,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:55:57,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fde19d3a3b3c0cf9a44bc6d567be31f2: 2023-03-22 17:55:57,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679507674613.fde19d3a3b3c0cf9a44bc6d567be31f2. 2023-03-22 17:55:57,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bf4ad76645cab3c5938606f0a9ae870, disabling compactions & flushes 2023-03-22 17:55:57,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. after waiting 0 ms 2023-03-22 17:55:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:57,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/ns/testMinorCompaction/6bf4ad76645cab3c5938606f0a9ae870/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:57,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bf4ad76645cab3c5938606f0a9ae870: 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1679507712304.6bf4ad76645cab3c5938606f0a9ae870. 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef607e06cf69000c37dd9f95ef6d924a, disabling compactions & flushes 2023-03-22 17:55:57,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. after waiting 0 ms 2023-03-22 17:55:57,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/ef607e06cf69000c37dd9f95ef6d924a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-22 17:55:57,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef607e06cf69000c37dd9f95ef6d924a: 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1679507651438.ef607e06cf69000c37dd9f95ef6d924a. 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5f1ba5448b3f743247bcb076351a8be, disabling compactions & flushes 2023-03-22 17:55:57,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:55:57,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. after waiting 0 ms 2023-03-22 17:55:57,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:55:57,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionWithWeeklyPolicy/b5f1ba5448b3f743247bcb076351a8be/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-22 17:55:57,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:55:57,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5f1ba5448b3f743247bcb076351a8be: 2023-03-22 17:55:57,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1679507655901.b5f1ba5448b3f743247bcb076351a8be. 2023-03-22 17:55:57,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72d334bfaccf92d12e3cc29b15536ea4, disabling compactions & flushes 2023-03-22 17:55:57,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:57,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:57,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. after waiting 0 ms 2023-03-22 17:55:57,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:57,857 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/72d334bfaccf92d12e3cc29b15536ea4/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-22 17:55:57,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72d334bfaccf92d12e3cc29b15536ea4: 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1679507692472.72d334bfaccf92d12e3cc29b15536ea4. 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8bfb56d80101d7d405037a15c1758d60, disabling compactions & flushes 2023-03-22 17:55:57,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. after waiting 0 ms 2023-03-22 17:55:57,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:55:57,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8bfb56d80101d7d405037a15c1758d60 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-22 17:55:57,974 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1505): Waiting on 1588230740, 34b5c9c5b6abd41e9a7d80e152ae4896, 62875c1cb9dc4a5947ba040718dc77cc, 7710f9558c323b3df8c9bddcf1414c52, 8bfb56d80101d7d405037a15c1758d60, d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:58,175 DEBUG [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1505): Waiting on 1588230740, 34b5c9c5b6abd41e9a7d80e152ae4896, 62875c1cb9dc4a5947ba040718dc77cc, 7710f9558c323b3df8c9bddcf1414c52, 8bfb56d80101d7d405037a15c1758d60, d5724222967b26b81b2994ecd84a2482 2023-03-22 17:55:58,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/info/cab58cd998d342da9fb30afb97a8f8f9 2023-03-22 17:55:58,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab58cd998d342da9fb30afb97a8f8f9 2023-03-22 17:55:58,206 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/rep_barrier/aa5ca490de634d5d8c06fa44bd05c499 2023-03-22 17:55:58,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa5ca490de634d5d8c06fa44bd05c499 2023-03-22 17:55:58,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/table/6a79343657304d27a211421352fa43f0 2023-03-22 17:55:58,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a79343657304d27a211421352fa43f0 2023-03-22 17:55:58,222 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/info/cab58cd998d342da9fb30afb97a8f8f9 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/info/cab58cd998d342da9fb30afb97a8f8f9 2023-03-22 17:55:58,226 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab58cd998d342da9fb30afb97a8f8f9 2023-03-22 17:55:58,226 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/info/cab58cd998d342da9fb30afb97a8f8f9, entries=226, sequenceid=130, filesize=37.9 K 2023-03-22 17:55:58,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/rep_barrier/aa5ca490de634d5d8c06fa44bd05c499 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/rep_barrier/aa5ca490de634d5d8c06fa44bd05c499 2023-03-22 17:55:58,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa5ca490de634d5d8c06fa44bd05c499 2023-03-22 17:55:58,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/rep_barrier/aa5ca490de634d5d8c06fa44bd05c499, entries=1, sequenceid=130, filesize=5.0 K 2023-03-22 17:55:58,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/.tmp/table/6a79343657304d27a211421352fa43f0 as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/table/6a79343657304d27a211421352fa43f0 2023-03-22 17:55:58,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a79343657304d27a211421352fa43f0 2023-03-22 17:55:58,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/table/6a79343657304d27a211421352fa43f0, entries=27, sequenceid=130, filesize=6.6 K 2023-03-22 17:55:58,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 462ms, sequenceid=130, compaction requested=false 2023-03-22 17:55:58,240 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-22 17:55:58,241 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-22 17:55:58,241 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-22 17:55:58,241 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-22 17:55:58,241 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-22 17:55:58,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/.tmp/info/32d0c7468165482283ba26a393baf30a 2023-03-22 17:55:58,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/.tmp/info/32d0c7468165482283ba26a393baf30a as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/info/32d0c7468165482283ba26a393baf30a 2023-03-22 17:55:58,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/info/32d0c7468165482283ba26a393baf30a, entries=3, sequenceid=7, filesize=4.8 K 2023-03-22 17:55:58,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 8bfb56d80101d7d405037a15c1758d60 in 415ms, sequenceid=7, compaction requested=false 2023-03-22 17:55:58,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/hbase/namespace/8bfb56d80101d7d405037a15c1758d60/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-22 17:55:58,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:55:58,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8bfb56d80101d7d405037a15c1758d60: 2023-03-22 17:55:58,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1679507620336.8bfb56d80101d7d405037a15c1758d60. 2023-03-22 17:55:58,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62875c1cb9dc4a5947ba040718dc77cc, disabling compactions & flushes 2023-03-22 17:55:58,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:58,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:58,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. after waiting 0 ms 2023-03-22 17:55:58,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:58,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testCompactionWithHFileLink/62875c1cb9dc4a5947ba040718dc77cc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-22 17:55:58,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62875c1cb9dc4a5947ba040718dc77cc: 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1679507692472.62875c1cb9dc4a5947ba040718dc77cc. 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34b5c9c5b6abd41e9a7d80e152ae4896, disabling compactions & flushes 2023-03-22 17:55:58,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. after waiting 0 ms 2023-03-22 17:55:58,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testScannerOnBulkLoadRefHFiles/34b5c9c5b6abd41e9a7d80e152ae4896/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-22 17:55:58,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34b5c9c5b6abd41e9a7d80e152ae4896: 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1679507651438.34b5c9c5b6abd41e9a7d80e152ae4896. 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7710f9558c323b3df8c9bddcf1414c52, disabling compactions & flushes 2023-03-22 17:55:58,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. after waiting 0 ms 2023-03-22 17:55:58,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMajorCompactionFromAdmin/7710f9558c323b3df8c9bddcf1414c52/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-22 17:55:58,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7710f9558c323b3df8c9bddcf1414c52: 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1679507738546.7710f9558c323b3df8c9bddcf1414c52. 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5724222967b26b81b2994ecd84a2482, disabling compactions & flushes 2023-03-22 17:55:58,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. after waiting 0 ms 2023-03-22 17:55:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:58,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/data/default/testMinorCompactionWithMonthlyPolicy/d5724222967b26b81b2994ecd84a2482/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-22 17:55:58,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:58,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5724222967b26b81b2994ecd84a2482: 2023-03-22 17:55:58,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1679507729217.d5724222967b26b81b2994ecd84a2482. 2023-03-22 17:55:58,375 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46619,1679507617635; all regions closed. 2023-03-22 17:55:58,382 DEBUG [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/oldWALs 2023-03-22 17:55:58,382 INFO [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46619%2C1679507617635.meta:.meta(num 1679507620070) 2023-03-22 17:55:58,384 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-22 17:55:58,384 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-22 17:55:58,387 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/WALs/jenkins-hbase4.apache.org,46619,1679507617635/jenkins-hbase4.apache.org%2C46619%2C1679507617635.1679507619506 not finished, retry = 0 2023-03-22 17:55:58,489 DEBUG [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/oldWALs 2023-03-22 17:55:58,489 INFO [RS:0;jenkins-hbase4:46619] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46619%2C1679507617635:(num 1679507619506) 2023-03-22 17:55:58,489 DEBUG [RS:0;jenkins-hbase4:46619] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:58,489 INFO [RS:0;jenkins-hbase4:46619] regionserver.LeaseManager(133): Closed leases 2023-03-22 17:55:58,490 INFO [RS:0;jenkins-hbase4:46619] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-22 17:55:58,490 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-22 17:55:58,492 INFO [RS:0;jenkins-hbase4:46619] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46619 2023-03-22 17:55:58,500 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46619,1679507617635 2023-03-22 17:55:58,500 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-22 17:55:58,500 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-22 17:55:58,500 ERROR [Listener at localhost/34365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@735ebce3 rejected from java.util.concurrent.ThreadPoolExecutor@77613650[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-22 17:55:58,501 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46619,1679507617635] 2023-03-22 17:55:58,502 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46619,1679507617635; numProcessing=1 2023-03-22 17:55:58,503 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46619,1679507617635 already deleted, retry=false 2023-03-22 17:55:58,503 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46619,1679507617635 expired; onlineServers=0 2023-03-22 17:55:58,503 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40261,1679507616391' ***** 2023-03-22 17:55:58,503 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-22 17:55:58,504 DEBUG [M:0;jenkins-hbase4:40261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6289211a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-22 17:55:58,504 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40261,1679507616391 2023-03-22 17:55:58,504 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40261,1679507616391; all regions closed. 2023-03-22 17:55:58,504 DEBUG [M:0;jenkins-hbase4:40261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-22 17:55:58,504 DEBUG [M:0;jenkins-hbase4:40261] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-22 17:55:58,504 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-22 17:55:58,504 DEBUG [M:0;jenkins-hbase4:40261] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-22 17:55:58,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679507619205] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679507619205,5,FailOnTimeoutGroup] 2023-03-22 17:55:58,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679507619206] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679507619206,5,FailOnTimeoutGroup] 2023-03-22 17:55:58,505 INFO [M:0;jenkins-hbase4:40261] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-22 17:55:58,505 INFO [M:0;jenkins-hbase4:40261] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-22 17:55:58,505 INFO [M:0;jenkins-hbase4:40261] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-22 17:55:58,505 DEBUG [M:0;jenkins-hbase4:40261] master.HMaster(1512): Stopping service threads 2023-03-22 17:55:58,506 INFO [M:0;jenkins-hbase4:40261] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-22 17:55:58,506 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-22 17:55:58,506 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-22 17:55:58,506 ERROR [M:0;jenkins-hbase4:40261] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-22 17:55:58,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-22 17:55:58,507 INFO [M:0;jenkins-hbase4:40261] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-22 17:55:58,507 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-22 17:55:58,507 DEBUG [M:0;jenkins-hbase4:40261] zookeeper.ZKUtil(398): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-22 17:55:58,507 WARN [M:0;jenkins-hbase4:40261] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-22 17:55:58,507 INFO [M:0;jenkins-hbase4:40261] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-22 17:55:58,507 INFO [M:0;jenkins-hbase4:40261] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-22 17:55:58,507 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-22 17:55:58,507 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:55:58,507 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:55:58,507 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-22 17:55:58,507 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:55:58,508 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.84 KB heapSize=598.65 KB 2023-03-22 17:55:58,601 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-22 17:55:58,601 INFO [RS:0;jenkins-hbase4:46619] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46619,1679507617635; zookeeper connection closed. 2023-03-22 17:55:58,602 ERROR [Listener at localhost/34365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5249de9 rejected from java.util.concurrent.ThreadPoolExecutor@77613650[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-22 17:55:58,602 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): regionserver:46619-0x1010d5c58f70001, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-22 17:55:58,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5fabc45f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5fabc45f 2023-03-22 17:55:58,602 ERROR [Listener at localhost/34365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7db6f58f rejected from java.util.concurrent.ThreadPoolExecutor@77613650[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-22 17:55:58,602 INFO [Listener at localhost/34365] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-22 17:55:58,919 INFO [M:0;jenkins-hbase4:40261] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.84 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d7dcdd62670e45fcb0c80ac5dcb788bc 2023-03-22 17:55:58,922 INFO [M:0;jenkins-hbase4:40261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7dcdd62670e45fcb0c80ac5dcb788bc 2023-03-22 17:55:58,923 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d7dcdd62670e45fcb0c80ac5dcb788bc as hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d7dcdd62670e45fcb0c80ac5dcb788bc 2023-03-22 17:55:58,926 INFO [M:0;jenkins-hbase4:40261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7dcdd62670e45fcb0c80ac5dcb788bc 2023-03-22 17:55:58,926 INFO [M:0;jenkins-hbase4:40261] regionserver.HStore(1080): Added hdfs://localhost:39935/user/jenkins/test-data/bdabc4ea-9cb0-f960-bf15-65050a5686e8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d7dcdd62670e45fcb0c80ac5dcb788bc, entries=123, sequenceid=1006, filesize=33.3 K 2023-03-22 17:55:58,927 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegion(2948): Finished flush of dataSize ~512.84 KB/525145, heapSize ~598.63 KB/613000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 419ms, sequenceid=1006, compaction requested=false 2023-03-22 17:55:58,928 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-22 17:55:58,928 DEBUG [M:0;jenkins-hbase4:40261] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-22 17:55:58,931 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-22 17:55:58,931 INFO [M:0;jenkins-hbase4:40261] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-22 17:55:58,931 INFO [M:0;jenkins-hbase4:40261] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40261 2023-03-22 17:55:58,934 DEBUG [M:0;jenkins-hbase4:40261] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40261,1679507616391 already deleted, retry=false 2023-03-22 17:55:59,036 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-22 17:55:59,036 INFO [M:0;jenkins-hbase4:40261] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40261,1679507616391; zookeeper connection closed. 2023-03-22 17:55:59,036 ERROR [Listener at localhost/34365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69638014 rejected from java.util.concurrent.ThreadPoolExecutor@6e887ac8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 904] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-22 17:55:59,036 DEBUG [Listener at localhost/34365-EventThread] zookeeper.ZKWatcher(600): master:40261-0x1010d5c58f70000, quorum=127.0.0.1:60739, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-22 17:55:59,036 ERROR [Listener at localhost/34365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2de95e7b rejected from java.util.concurrent.ThreadPoolExecutor@6e887ac8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 904] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-22 17:55:59,038 WARN [Listener at localhost/34365] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-22 17:55:59,043 INFO [Listener at localhost/34365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-22 17:55:59,149 WARN [BP-822094934-172.31.14.131-1679507613031 heartbeating to localhost/127.0.0.1:39935] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-22 17:55:59,150 WARN [BP-822094934-172.31.14.131-1679507613031 heartbeating to localhost/127.0.0.1:39935] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-822094934-172.31.14.131-1679507613031 (Datanode Uuid 3abc8896-64a6-46b1-a948-dd067e76a115) service to localhost/127.0.0.1:39935 2023-03-22 17:55:59,153 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/dfs/data/data1/current/BP-822094934-172.31.14.131-1679507613031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-22 17:55:59,153 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fc818dab-8a7b-8343-bb5a-9042746e1371/cluster_891679af-a88a-614c-9f03-11781fe071a8/dfs/data/data2/current/BP-822094934-172.31.14.131-1679507613031] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-22 17:55:59,186 INFO [Listener at localhost/34365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-22 17:55:59,327 INFO [Listener at localhost/34365] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-22 17:55:59,423 INFO [Listener at localhost/34365] hbase.HBaseTestingUtility(1293): Minicluster is down