2023-03-14 10:53:28,482 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-14 10:53:28,743 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef 2023-03-14 10:53:28,761 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-14 10:53:28,761 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8, deleteOnExit=true 2023-03-14 10:53:28,762 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-14 10:53:28,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/test.cache.data in system properties and HBase conf 2023-03-14 10:53:28,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/hadoop.tmp.dir in system properties and HBase conf 2023-03-14 10:53:28,764 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/hadoop.log.dir in system properties and HBase conf 2023-03-14 10:53:28,764 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-14 10:53:28,765 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-14 10:53:28,765 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-14 10:53:28,880 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-14 10:53:29,285 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-14 10:53:29,290 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-14 10:53:29,290 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-14 10:53:29,291 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-14 10:53:29,291 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-14 10:53:29,291 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-14 10:53:29,291 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-14 10:53:29,292 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-14 10:53:29,292 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-14 10:53:29,293 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-14 10:53:29,293 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/nfs.dump.dir in system properties and HBase conf 2023-03-14 10:53:29,293 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/java.io.tmpdir in system properties and HBase conf 2023-03-14 10:53:29,294 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-14 10:53:29,294 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-14 10:53:29,295 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-14 10:53:29,900 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-14 10:53:29,905 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-14 10:53:30,200 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-14 10:53:30,383 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-14 10:53:30,403 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-14 10:53:30,447 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-14 10:53:30,482 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/java.io.tmpdir/Jetty_localhost_45969_hdfs____.3jpupn/webapp 2023-03-14 10:53:30,638 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45969 2023-03-14 10:53:30,689 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-14 10:53:30,690 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-14 10:53:31,102 WARN [Listener at localhost/40011] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-14 10:53:31,257 WARN [Listener at localhost/40011] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-14 10:53:31,277 WARN [Listener at localhost/40011] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-14 10:53:31,283 INFO [Listener at localhost/40011] log.Slf4jLog(67): jetty-6.1.26 2023-03-14 10:53:31,289 INFO [Listener at localhost/40011] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/java.io.tmpdir/Jetty_localhost_36767_datanode____uhof30/webapp 2023-03-14 10:53:31,392 INFO [Listener at localhost/40011] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36767 2023-03-14 10:53:31,810 WARN [Listener at localhost/44023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-14 10:53:32,386 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdfec70b3f54b6d29: Processing first storage report for DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7 from datanode eb09e7eb-30a0-480d-ad70-3fa28c74f7ed 2023-03-14 10:53:32,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdfec70b3f54b6d29: from storage DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7 node DatanodeRegistration(127.0.0.1:41251, datanodeUuid=eb09e7eb-30a0-480d-ad70-3fa28c74f7ed, infoPort=39893, infoSecurePort=0, ipcPort=44023, storageInfo=lv=-57;cid=testClusterID;nsid=1326313785;c=1678791209982), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-14 10:53:32,389 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdfec70b3f54b6d29: Processing first storage report for DS-0e334e57-56d0-41a5-89b6-991279cc42cc from datanode eb09e7eb-30a0-480d-ad70-3fa28c74f7ed 2023-03-14 10:53:32,389 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdfec70b3f54b6d29: from storage DS-0e334e57-56d0-41a5-89b6-991279cc42cc node DatanodeRegistration(127.0.0.1:41251, datanodeUuid=eb09e7eb-30a0-480d-ad70-3fa28c74f7ed, infoPort=39893, infoSecurePort=0, ipcPort=44023, storageInfo=lv=-57;cid=testClusterID;nsid=1326313785;c=1678791209982), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-14 10:53:32,460 DEBUG [Listener at localhost/44023] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef 2023-03-14 10:53:32,532 INFO [Listener at localhost/44023] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/zookeeper_0, clientPort=58692, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-14 10:53:32,550 INFO [Listener at localhost/44023] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58692 2023-03-14 10:53:32,558 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:32,560 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:33,216 INFO [Listener at localhost/44023] util.FSUtils(471): Created version file at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b with version=8 2023-03-14 10:53:33,217 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/hbase-staging 2023-03-14 10:53:33,535 INFO [Listener at localhost/44023] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-14 10:53:34,033 INFO [Listener at localhost/44023] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-14 10:53:34,064 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,065 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,065 INFO [Listener at localhost/44023] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-14 10:53:34,065 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,065 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-14 10:53:34,239 INFO [Listener at localhost/44023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-14 10:53:34,312 DEBUG [Listener at localhost/44023] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-14 10:53:34,406 INFO [Listener at localhost/44023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37569 2023-03-14 10:53:34,416 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:34,419 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:34,440 INFO [Listener at localhost/44023] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37569 connecting to ZooKeeper ensemble=127.0.0.1:58692 2023-03-14 10:53:34,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:375690x0, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-14 10:53:34,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37569-0x100e2a8e7a50000 connected 2023-03-14 10:53:34,519 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 10:53:34,519 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 10:53:34,523 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-14 10:53:34,530 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37569 2023-03-14 10:53:34,531 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37569 2023-03-14 10:53:34,531 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37569 2023-03-14 10:53:34,532 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37569 2023-03-14 10:53:34,534 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37569 2023-03-14 10:53:34,540 INFO [Listener at localhost/44023] master.HMaster(444): hbase.rootdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b, hbase.cluster.distributed=false 2023-03-14 10:53:34,612 INFO [Listener at localhost/44023] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-14 10:53:34,612 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,613 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,613 INFO [Listener at localhost/44023] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-14 10:53:34,613 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 10:53:34,613 INFO [Listener at localhost/44023] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-14 10:53:34,618 INFO [Listener at localhost/44023] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-14 10:53:34,621 INFO [Listener at localhost/44023] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36455 2023-03-14 10:53:34,623 INFO [Listener at localhost/44023] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-14 10:53:34,629 DEBUG [Listener at localhost/44023] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-14 10:53:34,630 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:34,635 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:34,637 INFO [Listener at localhost/44023] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36455 connecting to ZooKeeper ensemble=127.0.0.1:58692 2023-03-14 10:53:34,641 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:364550x0, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-14 10:53:34,642 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): regionserver:364550x0, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 10:53:34,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36455-0x100e2a8e7a50001 connected 2023-03-14 10:53:34,643 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 10:53:34,644 DEBUG [Listener at localhost/44023] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-14 10:53:34,646 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36455 2023-03-14 10:53:34,646 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36455 2023-03-14 10:53:34,646 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36455 2023-03-14 10:53:34,647 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36455 2023-03-14 10:53:34,648 DEBUG [Listener at localhost/44023] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36455 2023-03-14 10:53:34,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:34,659 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-14 10:53:34,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:34,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-14 10:53:34,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-14 10:53:34,681 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:34,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-14 10:53:34,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37569,1678791213358 from backup master directory 2023-03-14 10:53:34,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-14 10:53:34,687 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:34,687 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-14 10:53:34,687 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-14 10:53:34,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:34,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-14 10:53:34,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-14 10:53:34,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/hbase.id with ID: b44f2fa3-b88e-4bc0-b817-ac2be0eff98f 2023-03-14 10:53:34,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:34,833 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:34,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x04dc6a2d to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:34,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fce74e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:34,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-14 10:53:34,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-14 10:53:34,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-14 10:53:34,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-14 10:53:34,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-14 10:53:34,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-14 10:53:34,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 10:53:35,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store-tmp 2023-03-14 10:53:35,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:35,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-14 10:53:35,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:53:35,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:53:35,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-14 10:53:35,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:53:35,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:53:35,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 10:53:35,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/WALs/jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:35,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37569%2C1678791213358, suffix=, logDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/WALs/jenkins-hbase4.apache.org,37569,1678791213358, archiveDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/oldWALs, maxLogs=10 2023-03-14 10:53:35,116 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK] 2023-03-14 10:53:35,125 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-14 10:53:35,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/WALs/jenkins-hbase4.apache.org,37569,1678791213358/jenkins-hbase4.apache.org%2C37569%2C1678791213358.1678791215067 2023-03-14 10:53:35,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK]] 2023-03-14 10:53:35,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:35,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:35,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,254 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,261 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-14 10:53:35,293 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-14 10:53:35,309 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:35,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 10:53:35,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:53:35,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75240933, jitterRate=0.12117727100849152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:53:35,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 10:53:35,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-14 10:53:35,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-14 10:53:35,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-14 10:53:35,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-14 10:53:35,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-14 10:53:35,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 33 msec 2023-03-14 10:53:35,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-14 10:53:35,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-14 10:53:35,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-14 10:53:35,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-14 10:53:35,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-14 10:53:35,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-14 10:53:35,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-14 10:53:35,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-14 10:53:35,492 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:35,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-14 10:53:35,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-14 10:53:35,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-14 10:53:35,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-14 10:53:35,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-14 10:53:35,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:35,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37569,1678791213358, sessionid=0x100e2a8e7a50000, setting cluster-up flag (Was=false) 2023-03-14 10:53:35,532 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:35,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-14 10:53:35,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:35,551 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:35,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-14 10:53:35,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:35,561 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp 2023-03-14 10:53:35,653 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(952): ClusterId : b44f2fa3-b88e-4bc0-b817-ac2be0eff98f 2023-03-14 10:53:35,659 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-14 10:53:35,666 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-14 10:53:35,666 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-14 10:53:35,671 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-14 10:53:35,672 DEBUG [RS:0;jenkins-hbase4:36455] zookeeper.ReadOnlyZKClient(139): Connect 0x23865418 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:35,681 DEBUG [RS:0;jenkins-hbase4:36455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d41be18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:35,682 DEBUG [RS:0;jenkins-hbase4:36455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297e3f68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-14 10:53:35,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-14 10:53:35,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-14 10:53:35,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-14 10:53:35,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-14 10:53:35,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-14 10:53:35,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-14 10:53:35,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-14 10:53:35,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678791245709 2023-03-14 10:53:35,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-14 10:53:35,713 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-14 10:53:35,714 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-14 10:53:35,716 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36455 2023-03-14 10:53:35,720 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-14 10:53:35,721 INFO [RS:0;jenkins-hbase4:36455] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-14 10:53:35,722 INFO [RS:0;jenkins-hbase4:36455] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-14 10:53:35,722 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1023): About to register with Master. 2023-03-14 10:53:35,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-14 10:53:35,726 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37569,1678791213358 with isa=jenkins-hbase4.apache.org/172.31.14.131:36455, startcode=1678791214611 2023-03-14 10:53:35,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-14 10:53:35,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-14 10:53:35,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-14 10:53:35,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-14 10:53:35,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-14 10:53:35,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-14 10:53:35,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-14 10:53:35,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-14 10:53:35,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-14 10:53:35,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678791215744,5,FailOnTimeoutGroup] 2023-03-14 10:53:35,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678791215744,5,FailOnTimeoutGroup] 2023-03-14 10:53:35,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-14 10:53:35,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,752 DEBUG [RS:0;jenkins-hbase4:36455] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-14 10:53:35,759 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:35,760 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:35,760 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b 2023-03-14 10:53:35,776 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:35,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-14 10:53:35,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/info 2023-03-14 10:53:35,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-14 10:53:35,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:35,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-14 10:53:35,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/rep_barrier 2023-03-14 10:53:35,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-14 10:53:35,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:35,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-14 10:53:35,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/table 2023-03-14 10:53:35,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-14 10:53:35,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:35,797 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740 2023-03-14 10:53:35,798 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740 2023-03-14 10:53:35,802 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-14 10:53:35,805 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-14 10:53:35,809 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:53:35,810 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65377845, jitterRate=-0.025794193148612976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-14 10:53:35,811 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-14 10:53:35,811 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-14 10:53:35,811 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-14 10:53:35,811 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-14 10:53:35,811 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-14 10:53:35,811 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-14 10:53:35,812 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-14 10:53:35,812 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-14 10:53:35,818 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-14 10:53:35,818 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-14 10:53:35,819 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59655, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-14 10:53:35,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-14 10:53:35,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,840 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-14 10:53:35,843 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-14 10:53:35,851 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b 2023-03-14 10:53:35,851 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40011 2023-03-14 10:53:35,851 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-14 10:53:35,856 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 10:53:35,857 DEBUG [RS:0;jenkins-hbase4:36455] zookeeper.ZKUtil(162): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,857 WARN [RS:0;jenkins-hbase4:36455] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-14 10:53:35,858 INFO [RS:0;jenkins-hbase4:36455] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 10:53:35,858 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/WALs/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,860 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36455,1678791214611] 2023-03-14 10:53:35,867 DEBUG [RS:0;jenkins-hbase4:36455] zookeeper.ZKUtil(162): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,878 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-14 10:53:35,887 INFO [RS:0;jenkins-hbase4:36455] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-14 10:53:35,912 INFO [RS:0;jenkins-hbase4:36455] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-14 10:53:35,921 INFO [RS:0;jenkins-hbase4:36455] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:53:35,921 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,922 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-14 10:53:35,930 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,931 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-14 10:53:35,932 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,932 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,932 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,932 DEBUG [RS:0;jenkins-hbase4:36455] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-14 10:53:35,933 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,933 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,933 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,952 INFO [RS:0;jenkins-hbase4:36455] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-14 10:53:35,954 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36455,1678791214611-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:35,972 INFO [RS:0;jenkins-hbase4:36455] regionserver.Replication(203): jenkins-hbase4.apache.org,36455,1678791214611 started 2023-03-14 10:53:35,972 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36455,1678791214611, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36455, sessionid=0x100e2a8e7a50001 2023-03-14 10:53:35,972 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-14 10:53:35,972 DEBUG [RS:0;jenkins-hbase4:36455] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,972 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36455,1678791214611' 2023-03-14 10:53:35,972 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:35,973 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:35,973 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-14 10:53:35,973 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-14 10:53:35,973 DEBUG [RS:0;jenkins-hbase4:36455] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:35,974 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36455,1678791214611' 2023-03-14 10:53:35,974 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 10:53:35,974 DEBUG [RS:0;jenkins-hbase4:36455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 10:53:35,974 DEBUG [RS:0;jenkins-hbase4:36455] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-14 10:53:35,974 INFO [RS:0;jenkins-hbase4:36455] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-14 10:53:35,975 INFO [RS:0;jenkins-hbase4:36455] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-14 10:53:35,995 DEBUG [jenkins-hbase4:37569] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-14 10:53:35,999 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36455,1678791214611, state=OPENING 2023-03-14 10:53:36,008 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-14 10:53:36,010 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:36,011 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-14 10:53:36,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:36,088 INFO [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36455%2C1678791214611, suffix=, logDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/WALs/jenkins-hbase4.apache.org,36455,1678791214611, archiveDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/oldWALs, maxLogs=32 2023-03-14 10:53:36,110 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK] 2023-03-14 10:53:36,114 INFO [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/WALs/jenkins-hbase4.apache.org,36455,1678791214611/jenkins-hbase4.apache.org%2C36455%2C1678791214611.1678791216092 2023-03-14 10:53:36,115 DEBUG [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK]] 2023-03-14 10:53:36,205 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:36,207 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 10:53:36,211 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 10:53:36,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-14 10:53:36,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 10:53:36,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36455%2C1678791214611.meta, suffix=.meta, logDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/WALs/jenkins-hbase4.apache.org,36455,1678791214611, archiveDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/oldWALs, maxLogs=32 2023-03-14 10:53:36,251 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK] 2023-03-14 10:53:36,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/WALs/jenkins-hbase4.apache.org,36455,1678791214611/jenkins-hbase4.apache.org%2C36455%2C1678791214611.meta.1678791216229.meta 2023-03-14 10:53:36,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41251,DS-6245a2da-feaf-44c7-a5a7-2d6f827619a7,DISK]] 2023-03-14 10:53:36,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:36,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-14 10:53:36,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-14 10:53:36,290 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-14 10:53:36,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-14 10:53:36,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:36,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-14 10:53:36,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-14 10:53:36,300 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-14 10:53:36,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/info 2023-03-14 10:53:36,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/info 2023-03-14 10:53:36,302 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-14 10:53:36,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:36,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-14 10:53:36,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/rep_barrier 2023-03-14 10:53:36,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/rep_barrier 2023-03-14 10:53:36,306 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-14 10:53:36,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:36,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-14 10:53:36,309 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/table 2023-03-14 10:53:36,309 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/table 2023-03-14 10:53:36,310 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-14 10:53:36,311 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:36,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740 2023-03-14 10:53:36,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740 2023-03-14 10:53:36,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-14 10:53:36,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-14 10:53:36,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60726363, jitterRate=-0.09510667622089386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-14 10:53:36,326 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-14 10:53:36,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678791216196 2023-03-14 10:53:36,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-14 10:53:36,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-14 10:53:36,358 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36455,1678791214611, state=OPEN 2023-03-14 10:53:36,361 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-14 10:53:36,361 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-14 10:53:36,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-14 10:53:36,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36455,1678791214611 in 347 msec 2023-03-14 10:53:36,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-14 10:53:36,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 541 msec 2023-03-14 10:53:36,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 772 msec 2023-03-14 10:53:36,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678791216380, completionTime=-1 2023-03-14 10:53:36,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-14 10:53:36,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-14 10:53:36,464 DEBUG [hconnection-0x51aa31ad-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:53:36,468 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:53:36,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-14 10:53:36,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678791276487 2023-03-14 10:53:36,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678791336487 2023-03-14 10:53:36,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 106 msec 2023-03-14 10:53:36,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37569,1678791213358-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:36,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37569,1678791213358-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:36,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37569,1678791213358-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:36,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37569, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:36,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-14 10:53:36,516 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-14 10:53:36,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-14 10:53:36,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-14 10:53:36,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-14 10:53:36,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:53:36,539 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:53:36,567 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/hbase/namespace/1576252b5b8296373a155035d76450f0 2023-03-14 10:53:36,570 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/hbase/namespace/1576252b5b8296373a155035d76450f0 empty. 2023-03-14 10:53:36,571 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/hbase/namespace/1576252b5b8296373a155035d76450f0 2023-03-14 10:53:36,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-14 10:53:37,004 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:37,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1576252b5b8296373a155035d76450f0, NAME => 'hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:53:37,019 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:37,019 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1576252b5b8296373a155035d76450f0, disabling compactions & flushes 2023-03-14 10:53:37,020 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. after waiting 0 ms 2023-03-14 10:53:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,020 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1576252b5b8296373a155035d76450f0: 2023-03-14 10:53:37,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:53:37,042 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678791217027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791217027"}]},"ts":"1678791217027"} 2023-03-14 10:53:37,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:53:37,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:53:37,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791217076"}]},"ts":"1678791217076"} 2023-03-14 10:53:37,088 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-14 10:53:37,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1576252b5b8296373a155035d76450f0, ASSIGN}] 2023-03-14 10:53:37,101 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1576252b5b8296373a155035d76450f0, ASSIGN 2023-03-14 10:53:37,103 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1576252b5b8296373a155035d76450f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:53:37,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1576252b5b8296373a155035d76450f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:37,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678791217254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791217254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791217254"}]},"ts":"1678791217254"} 2023-03-14 10:53:37,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1576252b5b8296373a155035d76450f0, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:37,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1576252b5b8296373a155035d76450f0, NAME => 'hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:37,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:37,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,423 INFO [StoreOpener-1576252b5b8296373a155035d76450f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,425 DEBUG [StoreOpener-1576252b5b8296373a155035d76450f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/info 2023-03-14 10:53:37,425 DEBUG [StoreOpener-1576252b5b8296373a155035d76450f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/info 2023-03-14 10:53:37,426 INFO [StoreOpener-1576252b5b8296373a155035d76450f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1576252b5b8296373a155035d76450f0 columnFamilyName info 2023-03-14 10:53:37,427 INFO [StoreOpener-1576252b5b8296373a155035d76450f0-1] regionserver.HStore(310): Store=1576252b5b8296373a155035d76450f0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:37,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1576252b5b8296373a155035d76450f0 2023-03-14 10:53:37,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:53:37,437 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1576252b5b8296373a155035d76450f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72883249, jitterRate=0.086045041680336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:53:37,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1576252b5b8296373a155035d76450f0: 2023-03-14 10:53:37,439 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0., pid=6, masterSystemTime=1678791217413 2023-03-14 10:53:37,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:53:37,445 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1576252b5b8296373a155035d76450f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:37,446 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678791217445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791217445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791217445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791217445"}]},"ts":"1678791217445"} 2023-03-14 10:53:37,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-14 10:53:37,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1576252b5b8296373a155035d76450f0, server=jenkins-hbase4.apache.org,36455,1678791214611 in 191 msec 2023-03-14 10:53:37,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-14 10:53:37,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1576252b5b8296373a155035d76450f0, ASSIGN in 355 msec 2023-03-14 10:53:37,460 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:53:37,460 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791217460"}]},"ts":"1678791217460"} 2023-03-14 10:53:37,463 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-14 10:53:37,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:53:37,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 943 msec 2023-03-14 10:53:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-14 10:53:37,539 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-14 10:53:37,539 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:53:37,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-14 10:53:37,598 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 10:53:37,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-03-14 10:53:37,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-14 10:53:37,638 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 10:53:37,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-03-14 10:53:37,659 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-14 10:53:37,661 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-14 10:53:37,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.973sec 2023-03-14 10:53:37,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-14 10:53:37,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-14 10:53:37,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-14 10:53:37,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37569,1678791213358-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-14 10:53:37,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37569,1678791213358-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-14 10:53:37,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-14 10:53:37,759 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(139): Connect 0x5759ba4d to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:37,764 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@449b853a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:37,779 DEBUG [hconnection-0x684e302b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:53:37,794 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:53:37,813 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:53:37,814 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(139): Connect 0x47652242 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:37,820 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143ae868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:37,820 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:53:37,846 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=356, ProcessCount=169, AvailableMemoryMB=3111 2023-03-14 10:53:37,858 DEBUG [Listener at localhost/44023] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:53:37,862 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:53:37,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:53:37,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:37,881 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:53:37,883 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:53:37,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-14 10:53:37,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:37,889 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d empty. 2023-03-14 10:53:37,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:37,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-14 10:53:37,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 10:53:37,910 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:37,915 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 77adcadf2f1c695c5ad4e92d97a5ed5d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:53:38,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 10:53:38,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 10:53:38,329 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:38,330 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 77adcadf2f1c695c5ad4e92d97a5ed5d, disabling compactions & flushes 2023-03-14 10:53:38,330 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,330 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,330 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. after waiting 0 ms 2023-03-14 10:53:38,330 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,330 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,330 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:38,334 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:53:38,336 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791218335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791218335"}]},"ts":"1678791218335"} 2023-03-14 10:53:38,338 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:53:38,340 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:53:38,340 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791218340"}]},"ts":"1678791218340"} 2023-03-14 10:53:38,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-14 10:53:38,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, ASSIGN}] 2023-03-14 10:53:38,350 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, ASSIGN 2023-03-14 10:53:38,351 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:53:38,503 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:38,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791218503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791218503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791218503"}]},"ts":"1678791218503"} 2023-03-14 10:53:38,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:38,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 10:53:38,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77adcadf2f1c695c5ad4e92d97a5ed5d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,670 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,672 DEBUG [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:38,672 DEBUG [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:38,675 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77adcadf2f1c695c5ad4e92d97a5ed5d columnFamilyName family1 2023-03-14 10:53:38,678 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] regionserver.HStore(310): Store=77adcadf2f1c695c5ad4e92d97a5ed5d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:38,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:53:38,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77adcadf2f1c695c5ad4e92d97a5ed5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69598204, jitterRate=0.037094056606292725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:53:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:38,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., pid=11, masterSystemTime=1678791218660 2023-03-14 10:53:38,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:38,697 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:38,697 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791218697"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791218697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791218697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791218697"}]},"ts":"1678791218697"} 2023-03-14 10:53:38,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-14 10:53:38,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 194 msec 2023-03-14 10:53:38,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-14 10:53:38,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, ASSIGN in 356 msec 2023-03-14 10:53:38,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:53:38,709 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791218709"}]},"ts":"1678791218709"} 2023-03-14 10:53:38,711 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-14 10:53:38,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:53:38,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 838 msec 2023-03-14 10:53:39,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 10:53:39,017 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-14 10:53:39,040 DEBUG [hconnection-0x23d918c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:53:39,043 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:53:39,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:39,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,214 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:39,214 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:39,215 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:39,215 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:39,215 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,216 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,217 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:39,217 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:39,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:39,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:39,218 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:39,218 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:39,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:39,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:39,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:39,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:39,223 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:39,223 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:39,225 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:53:39,776 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b1744543d44648fd9154be83788fef6b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b1744543d44648fd9154be83788fef6b 2023-03-14 10:53:40,194 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/b27a6694c85345cebf3648554ff3ed74 2023-03-14 10:53:40,207 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/b27a6694c85345cebf3648554ff3ed74 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74 2023-03-14 10:53:40,217 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-14 10:53:40,220 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 996ms, sequenceid=5, compaction requested=false 2023-03-14 10:53:40,222 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:40,226 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:40,226 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:40,230 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,230 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:40,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:40,233 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b8f63e[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:40,233 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,235 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:40,235 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:40,235 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:40,238 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:40,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,238 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:40,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:40,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:40,238 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:40,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:40,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:40,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:40,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:40,241 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:40,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:40,242 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:40,242 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,242 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:40,244 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,244 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:40,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,244 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:40,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:40,245 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:40,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,246 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,254 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,254 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:40,254 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,254 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:40,254 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:40,255 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:40,255 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:40,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:40,255 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:40,255 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,255 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:40,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:40,257 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:40,258 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:40,358 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:40,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:40,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:40,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:40,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,377 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:40,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:40,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:40,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:40,378 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,378 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,380 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:40,380 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:40,380 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,380 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:40,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,381 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:40,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:40,382 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:40,382 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:40,383 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:40,383 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:53:40,812 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286ecf1f11b96340d6a82175105cb1240f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511286ecf1f11b96340d6a82175105cb1240f 2023-03-14 10:53:41,222 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/9c5950e666cd481380a8e16e4922602c 2023-03-14 10:53:41,231 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/9c5950e666cd481380a8e16e4922602c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c 2023-03-14 10:53:41,239 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:53:41,240 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 857ms, sequenceid=9, compaction requested=false 2023-03-14 10:53:41,240 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:41,240 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:41,240 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:41,241 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:41,241 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,241 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:41,241 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:41,244 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:41,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:41,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:41,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25d94701[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:41,246 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:41,246 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,248 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,248 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:41,248 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:41,248 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:41,248 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,248 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:41,250 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:41,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:41,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:41,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:41,254 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:41,254 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:41,254 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:41,254 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,254 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:41,259 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,259 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:41,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:41,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,260 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:41,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:41,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:41,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:41,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,262 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:41,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,265 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,266 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:41,266 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:41,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:41,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:41,266 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:41,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:41,266 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:41,266 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:41,267 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,367 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:41,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:41,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,378 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:41,379 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:41,379 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:41,379 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:41,380 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,380 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,381 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:41,381 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:41,382 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:41,382 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,383 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:41,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:41,383 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:41,383 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:41,384 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:41,384 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:41,384 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:41,384 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:41,384 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:41,384 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:41,812 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017114ccefa0e1479cb952152f36ba4163 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017114ccefa0e1479cb952152f36ba4163 2023-03-14 10:53:41,813 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:53:41,883 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-14 10:53:41,884 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-14 10:53:42,226 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/8801e87adcaa48c68854f89240ed6282 2023-03-14 10:53:42,236 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/8801e87adcaa48c68854f89240ed6282 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282 2023-03-14 10:53:42,248 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 10:53:42,249 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 865ms, sequenceid=13, compaction requested=true 2023-03-14 10:53:42,250 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:42,250 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:42,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:42,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:42,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:42,250 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:42,253 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,253 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:42,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:42,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36a1e8b1[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:42,257 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:42,257 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,258 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:42,259 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,259 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:42,262 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:42,262 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,262 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:42,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:42,268 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:42,268 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:42,268 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:42,269 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,269 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:42,271 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,271 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,271 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:42,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:42,272 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,274 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,278 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:42,278 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,278 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:42,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:42,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:42,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:42,278 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:42,279 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:42,279 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:42,279 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,280 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,280 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,280 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,280 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:42,280 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:42,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:42,380 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:42,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:42,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:42,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:42,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,392 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:42,392 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:42,393 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:42,393 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:42,393 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,393 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,395 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,395 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:42,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:42,395 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:42,395 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:42,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:42,398 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:42,398 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:42,398 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:42,824 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056db53d8af6c541d8828bbf95aa6cfce5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056db53d8af6c541d8828bbf95aa6cfce5 2023-03-14 10:53:43,235 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/92b368a522134d468f3ec6367939b6e6 2023-03-14 10:53:43,245 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/92b368a522134d468f3ec6367939b6e6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6 2023-03-14 10:53:43,258 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 10:53:43,261 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 863ms, sequenceid=17, compaction requested=true 2023-03-14 10:53:43,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:43,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:43,261 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:43,266 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:43,267 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:43,268 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,268 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e45586c[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:43,271 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:43,271 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,272 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,272 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:43,272 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:43,272 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:43,273 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,273 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:43,278 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:43,278 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:43,278 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:43,279 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:43,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:43,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:43,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:43,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:43,287 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:43,287 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:43,287 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:43,287 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,287 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:43,289 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,289 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:43,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:43,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:43,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,291 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,294 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,303 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:43,303 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:43,303 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:43,303 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:43,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:43,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:43,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:43,303 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:43,304 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:43,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:43,405 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:43,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:43,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:43,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,420 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:43,420 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,423 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:43,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:43,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:43,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:43,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:43,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:43,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,424 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:43,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:43,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:43,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:43,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:43,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:43,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:43,425 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:43,425 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:43,425 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:43,529 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-14 10:53:43,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-14 10:53:43,847 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a5044dc1c67543519191e2c09d88f141 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5044dc1c67543519191e2c09d88f141 2023-03-14 10:53:44,259 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/bed28385bc8048b4b9d7c3075b8e87a3 2023-03-14 10:53:44,269 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/bed28385bc8048b4b9d7c3075b8e87a3 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3 2023-03-14 10:53:44,278 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 10:53:44,282 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 857ms, sequenceid=21, compaction requested=true 2023-03-14 10:53:44,282 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:44,282 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:44,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:44,283 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:44,283 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,283 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:44,283 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:44,288 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,288 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,288 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,288 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:44,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b49509c[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:44,290 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:44,290 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,292 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,292 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:44,292 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:44,293 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:44,293 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,293 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:44,294 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:44,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:44,299 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:44,299 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:44,299 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:44,299 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,299 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:44,301 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,301 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,301 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,302 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,303 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,306 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,307 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:44,307 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:44,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:44,307 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:44,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:44,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:44,307 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:44,308 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:44,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:44,409 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:44,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:44,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:44,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:44,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,420 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:44,420 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:44,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:44,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:44,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,423 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:44,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:44,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,423 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:44,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:44,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:44,425 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:44,426 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:44,426 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:44,426 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:44,426 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:44,426 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:44,850 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e4890c651d624a3598d8616c637fb9a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4890c651d624a3598d8616c637fb9a4 2023-03-14 10:53:44,860 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/7c0dff2cc4c34b49b802c259cfe5d655 2023-03-14 10:53:44,872 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/7c0dff2cc4c34b49b802c259cfe5d655 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655 2023-03-14 10:53:44,879 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 10:53:44,881 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 454ms, sequenceid=25, compaction requested=true 2023-03-14 10:53:44,881 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:44,881 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:44,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:44,884 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,884 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,885 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,885 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:44,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5447f9bb[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:44,887 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:44,887 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,890 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:44,890 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,890 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:44,891 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:44,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:44,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:44,896 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:44,896 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:44,896 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:44,896 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,896 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:44,898 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,898 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:44,898 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:44,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:44,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:44,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,899 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,901 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:44,905 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:44,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:44,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:44,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:44,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:44,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:44,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,906 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:44,906 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,906 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,906 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:44,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:44,907 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:44,907 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:45,007 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:45,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:45,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,020 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:45,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,021 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:45,021 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:45,021 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,021 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,023 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:45,023 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:45,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:45,023 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,023 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:45,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,025 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:45,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,025 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:45,025 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,025 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:45,028 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:45,028 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:45,028 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:45,460 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015a55dfa69ab84114a894541b888b77ae to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015a55dfa69ab84114a894541b888b77ae 2023-03-14 10:53:45,471 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/e71108377b2342bdbd5695dc706b2fd6 2023-03-14 10:53:45,480 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/e71108377b2342bdbd5695dc706b2fd6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6 2023-03-14 10:53:45,496 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 10:53:45,497 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 469ms, sequenceid=29, compaction requested=true 2023-03-14 10:53:45,498 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:45,498 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:45,498 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:45,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:45,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d9a67e2[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:45,505 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:45,505 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,506 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:45,507 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,507 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:45,508 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:45,508 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,508 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,508 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:45,514 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:45,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:45,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:45,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,514 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:45,517 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,517 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,517 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:45,518 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,520 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:45,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:45,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:45,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:45,527 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:45,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:45,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:45,528 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,528 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,529 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,529 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,529 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:45,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:45,529 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:45,529 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:45,629 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:45,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:45,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:45,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:45,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,642 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:45,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:45,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:45,643 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,643 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,644 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,645 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,645 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:45,645 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:45,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:45,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:45,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:45,649 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:45,649 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:45,650 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:45,678 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a2227892b4b64e1a9ffe945b32dfc7a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2227892b4b64e1a9ffe945b32dfc7a4 2023-03-14 10:53:45,705 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/236abdc0c56e4898b53f544402ab0281 2023-03-14 10:53:45,714 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/236abdc0c56e4898b53f544402ab0281 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281 2023-03-14 10:53:45,720 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 10:53:45,722 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 72ms, sequenceid=33, compaction requested=true 2023-03-14 10:53:45,722 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:45,722 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:45,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:45,725 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,725 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:45,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7908c405[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:45,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:45,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,728 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:45,728 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,728 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:45,729 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:45,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:45,733 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:45,733 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:45,733 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:45,733 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,733 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:45,735 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,735 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:45,735 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:45,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:45,736 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,739 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:45,743 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:45,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:45,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:45,743 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,744 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,744 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,744 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:45,744 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:45,745 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:45,845 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:45,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:45,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:45,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:45,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,856 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:45,856 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,856 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:45,857 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:45,857 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,857 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,858 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,858 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:45,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:45,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:45,859 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:45,859 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,860 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,860 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:45,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:45,862 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:45,862 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:45,862 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:45,863 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:46,282 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090702117a51f8d642fe966857ada459e30b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090702117a51f8d642fe966857ada459e30b 2023-03-14 10:53:46,691 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/13b6fae3899344d38db204054ffe5a72 2023-03-14 10:53:46,700 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/13b6fae3899344d38db204054ffe5a72 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72 2023-03-14 10:53:46,707 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 10:53:46,708 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 845ms, sequenceid=37, compaction requested=true 2023-03-14 10:53:46,708 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:46,708 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:46,708 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:46,710 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:46,711 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,711 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:46,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:46,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8b4a608[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:46,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:46,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,714 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:46,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,715 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:46,717 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:46,717 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:46,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,717 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:46,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:46,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:46,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:46,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:46,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:46,720 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:46,720 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:46,720 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:46,720 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,720 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:46,722 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,722 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,722 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:46,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:46,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:46,723 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,724 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:46,726 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:46,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:46,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:46,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:46,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 10:53:46,726 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:46,727 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,727 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,727 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,727 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:46,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:46,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:46,727 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:46,828 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:46,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:46,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:46,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:46,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,838 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:46,838 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:46,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 10:53:46,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 10:53:46,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,841 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,841 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:46,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:46,841 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:46,841 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,842 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,842 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 10:53:46,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:46,843 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 10:53:46,843 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 10:53:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:46,844 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:46,844 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. started... 2023-03-14 10:53:46,844 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 77adcadf2f1c695c5ad4e92d97a5ed5d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:47,264 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d0222291ca114a088dca4c7e73df8ca5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120d0222291ca114a088dca4c7e73df8ca5 2023-03-14 10:53:47,717 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/a92da7ebb7af42728c561b1a6273b68c 2023-03-14 10:53:47,725 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/a92da7ebb7af42728c561b1a6273b68c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c 2023-03-14 10:53:47,733 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 10:53:47,734 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 77adcadf2f1c695c5ad4e92d97a5ed5d in 890ms, sequenceid=41, compaction requested=true 2023-03-14 10:53:47,735 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:47,735 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 10:53:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 10:53:47,738 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,738 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:47,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:47,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 10:53:47,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d51c84[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:47,741 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 10:53:47,741 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,742 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 10:53:47,742 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,742 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 10:53:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:47,747 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,747 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 10:53:47,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:47,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:47,747 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:47,747 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 10:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:47,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 10:53:47,752 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 10:53:47,752 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:47,752 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:47,752 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,752 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:47,754 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,755 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,755 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:47,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:47,755 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,757 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:47,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,760 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:47,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 10:53:47,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:47,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:47,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,760 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:47,861 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:47,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:47,867 DEBUG [Listener at localhost/44023] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 10:53:47,870 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41496, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 10:53:47,871 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:47,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:47,885 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:47,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:53:47,886 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791827886 2023-03-14 10:53:47,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:53:47,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-14 10:53:47,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:47,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x11c71955 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:47,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74d53c01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:47,904 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,381 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103312d3b1c4bef40688ba2e435302693cb to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103312d3b1c4bef40688ba2e435302693cb 2023-03-14 10:53:48,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:48,406 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:53:48,409 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:53:48,426 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:53:48,429 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:53:48,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c21848796079458da4a4e442da083801 first=Optional[r3] last=Optional[r6] 2023-03-14 10:53:48,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c21848796079458da4a4e442da083801}] 2023-03-14 10:53:48,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c21848796079458da4a4e442da083801 for inclusion in 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 10:53:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:53:48,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c21848796079458da4a4e442da083801 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6v4sd059qp12pljea8f59r6kbochvs7elh0fb9misf5l9h5uugehh98u5grh1aop/family1/c21848796079458da4a4e442da083801 2023-03-14 10:53:48,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6v4sd059qp12pljea8f59r6kbochvs7elh0fb9misf5l9h5uugehh98u5grh1aop/family1/c21848796079458da4a4e442da083801 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_ 2023-03-14 10:53:48,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6v4sd059qp12pljea8f59r6kbochvs7elh0fb9misf5l9h5uugehh98u5grh1aop/family1/c21848796079458da4a4e442da083801 into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_ - updating store file list. 2023-03-14 10:53:48,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_ into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:48,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6v4sd059qp12pljea8f59r6kbochvs7elh0fb9misf5l9h5uugehh98u5grh1aop/family1/c21848796079458da4a4e442da083801 into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_) 2023-03-14 10:53:48,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6v4sd059qp12pljea8f59r6kbochvs7elh0fb9misf5l9h5uugehh98u5grh1aop/family1/c21848796079458da4a4e442da083801 2023-03-14 10:53:48,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:53:48,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:53:48,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 is initiating minor compaction 2023-03-14 10:53:48,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@559d1a1d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:53:48,570 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:48,571 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp, totalSize=50.2 K 2023-03-14 10:53:48,571 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 9c5950e666cd481380a8e16e4922602c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 8801e87adcaa48c68854f89240ed6282, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 92b368a522134d468f3ec6367939b6e6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting bed28385bc8048b4b9d7c3075b8e87a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 7c0dff2cc4c34b49b802c259cfe5d655, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting e71108377b2342bdbd5695dc706b2fd6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 236abdc0c56e4898b53f544402ab0281, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 13b6fae3899344d38db204054ffe5a72, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:53:48,572 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting a92da7ebb7af42728c561b1a6273b68c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:53:48,573 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:53:48,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:48,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:53:48,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5044dc1c67543519191e2c09d88f141 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5044dc1c67543519191e2c09d88f141 2023-03-14 10:53:48,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4890c651d624a3598d8616c637fb9a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4890c651d624a3598d8616c637fb9a4 2023-03-14 10:53:48,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015a55dfa69ab84114a894541b888b77ae to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015a55dfa69ab84114a894541b888b77ae 2023-03-14 10:53:48,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2227892b4b64e1a9ffe945b32dfc7a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a2227892b4b64e1a9ffe945b32dfc7a4 2023-03-14 10:53:48,607 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-14 10:53:48,607 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 10:53:48,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:48,647 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 77adcadf2f1c695c5ad4e92d97a5ed5d#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:53:49,474 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/73d2fb84af234088953a06660fc777cb as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/73d2fb84af234088953a06660fc777cb 2023-03-14 10:53:49,491 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 of 77adcadf2f1c695c5ad4e92d97a5ed5d into 73d2fb84af234088953a06660fc777cb(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:53:49,491 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:49,493 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678791228566; duration=0sec 2023-03-14 10:53:49,494 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:53:49,502 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205590bb304d4394b449bb64016ba385d16 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205590bb304d4394b449bb64016ba385d16 2023-03-14 10:53:49,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:49,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_] to archive 2023-03-14 10:53:49,542 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78054b58574649f99cc219398561dcb5 first=Optional[r00] last=Optional[r2] 2023-03-14 10:53:49,543 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78054b58574649f99cc219398561dcb5}] 2023-03-14 10:53:49,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:53:49,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78054b58574649f99cc219398561dcb5 for inclusion in 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:49,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/9c5950e666cd481380a8e16e4922602c 2023-03-14 10:53:49,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/8801e87adcaa48c68854f89240ed6282 2023-03-14 10:53:49,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 10:53:49,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:53:49,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:49,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/92b368a522134d468f3ec6367939b6e6 2023-03-14 10:53:49,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/78054b58574649f99cc219398561dcb5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__csl3664jbv5s1piov433naik5gti02ahgkumsfbejqnhtb9lp3rcd5lniqggt08m/family1/78054b58574649f99cc219398561dcb5 2023-03-14 10:53:49,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/bed28385bc8048b4b9d7c3075b8e87a3 2023-03-14 10:53:49,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/7c0dff2cc4c34b49b802c259cfe5d655 2023-03-14 10:53:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__csl3664jbv5s1piov433naik5gti02ahgkumsfbejqnhtb9lp3rcd5lniqggt08m/family1/78054b58574649f99cc219398561dcb5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_ 2023-03-14 10:53:49,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__csl3664jbv5s1piov433naik5gti02ahgkumsfbejqnhtb9lp3rcd5lniqggt08m/family1/78054b58574649f99cc219398561dcb5 into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_ - updating store file list. 2023-03-14 10:53:49,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/e71108377b2342bdbd5695dc706b2fd6 2023-03-14 10:53:49,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/236abdc0c56e4898b53f544402ab0281 2023-03-14 10:53:49,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/13b6fae3899344d38db204054ffe5a72 2023-03-14 10:53:49,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a92da7ebb7af42728c561b1a6273b68c 2023-03-14 10:53:49,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_ into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:49,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__csl3664jbv5s1piov433naik5gti02ahgkumsfbejqnhtb9lp3rcd5lniqggt08m/family1/78054b58574649f99cc219398561dcb5 into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_) 2023-03-14 10:53:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__csl3664jbv5s1piov433naik5gti02ahgkumsfbejqnhtb9lp3rcd5lniqggt08m/family1/78054b58574649f99cc219398561dcb5 2023-03-14 10:53:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:53:49,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/4b7212bd6e414b51b3f0f65197cc9f70_SeqId_44_ 2023-03-14 10:53:49,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:53:49,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 is initiating minor compaction (all files) 2023-03-14 10:53:49,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4058eccf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:53:49,565 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:49,565 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/73d2fb84af234088953a06660fc777cb, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp, totalSize=358.6 K 2023-03-14 10:53:49,566 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b27a6694c85345cebf3648554ff3ed74, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:53:49,567 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 73d2fb84af234088953a06660fc777cb, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:53:49,567 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting a3d99a12f5554926bfd43313a74ba846_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837821 2023-03-14 10:53:49,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:49,569 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:53:49,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b1744543d44648fd9154be83788fef6b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b1744543d44648fd9154be83788fef6b 2023-03-14 10:53:49,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017114ccefa0e1479cb952152f36ba4163 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017114ccefa0e1479cb952152f36ba4163 2023-03-14 10:53:49,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056db53d8af6c541d8828bbf95aa6cfce5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056db53d8af6c541d8828bbf95aa6cfce5 2023-03-14 10:53:49,575 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-14 10:53:49,575 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 10:53:49,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:53:49,581 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:49,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.7040 sec 2023-03-14 10:53:49,609 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 77adcadf2f1c695c5ad4e92d97a5ed5d#family1#compaction#11 average throughput is 7.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:53:49,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 10:53:49,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:50,153 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-14 10:53:50,154 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:50,155 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-14 10:53:50,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-14 10:53:50,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, REOPEN/MOVE}] 2023-03-14 10:53:50,172 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, REOPEN/MOVE 2023-03-14 10:53:50,173 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:50,173 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791230173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791230173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791230173"}]},"ts":"1678791230173"} 2023-03-14 10:53:50,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:50,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77adcadf2f1c695c5ad4e92d97a5ed5d, disabling compactions & flushes 2023-03-14 10:53:50,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,448 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/.tmp/family1/1fdd298eb76d4b749b21d9517740ea5d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/1fdd298eb76d4b749b21d9517740ea5d 2023-03-14 10:53:50,455 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 of 77adcadf2f1c695c5ad4e92d97a5ed5d into 1fdd298eb76d4b749b21d9517740ea5d(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:53:50,455 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:50,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,455 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678791229565; duration=0sec 2023-03-14 10:53:50,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. after waiting 0 ms 2023-03-14 10:53:50,455 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:53:50,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,459 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/73d2fb84af234088953a06660fc777cb, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_] to archive 2023-03-14 10:53:50,460 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:53:50,462 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/b27a6694c85345cebf3648554ff3ed74 2023-03-14 10:53:50,463 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/73d2fb84af234088953a06660fc777cb to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/73d2fb84af234088953a06660fc777cb 2023-03-14 10:53:50,465 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/a3d99a12f5554926bfd43313a74ba846_SeqId_47_ 2023-03-14 10:53:50,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 10:53:50,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:50,472 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 77adcadf2f1c695c5ad4e92d97a5ed5d to self. 2023-03-14 10:53:50,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=CLOSED 2023-03-14 10:53:50,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791230475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791230475"}]},"ts":"1678791230475"} 2023-03-14 10:53:50,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-14 10:53:50,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 301 msec 2023-03-14 10:53:50,480 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=true 2023-03-14 10:53:50,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:50,631 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791230630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791230630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791230630"}]},"ts":"1678791230630"} 2023-03-14 10:53:50,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:50,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77adcadf2f1c695c5ad4e92d97a5ed5d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,791 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,792 DEBUG [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:50,793 DEBUG [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:50,793 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77adcadf2f1c695c5ad4e92d97a5ed5d columnFamilyName family1 2023-03-14 10:53:50,800 DEBUG [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/1fdd298eb76d4b749b21d9517740ea5d 2023-03-14 10:53:50,800 INFO [StoreOpener-77adcadf2f1c695c5ad4e92d97a5ed5d-1] regionserver.HStore(310): Store=77adcadf2f1c695c5ad4e92d97a5ed5d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:50,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:53:50,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77adcadf2f1c695c5ad4e92d97a5ed5d; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65341815, jitterRate=-0.026331081986427307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:53:50,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:50,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., pid=17, masterSystemTime=1678791230785 2023-03-14 10:53:50,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:53:50,811 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=77adcadf2f1c695c5ad4e92d97a5ed5d, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:50,811 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678791230810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791230810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791230810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791230810"}]},"ts":"1678791230810"} 2023-03-14 10:53:50,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-14 10:53:50,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 77adcadf2f1c695c5ad4e92d97a5ed5d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 180 msec 2023-03-14 10:53:50,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-14 10:53:50,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=77adcadf2f1c695c5ad4e92d97a5ed5d, REOPEN/MOVE in 644 msec 2023-03-14 10:53:50,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-14 10:53:50,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 660 msec 2023-03-14 10:53:50,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0920 sec 2023-03-14 10:53:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-14 10:53:50,832 INFO [Listener at localhost/44023] compactions.TestMobCompactor(278): alter status finished 2023-03-14 10:53:50,833 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 10:53:50,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:50,836 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:50,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:53:50,837 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791830837 2023-03-14 10:53:50,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:53:50,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-14 10:53:50,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:50,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x2b7ae3ec to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:53:50,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a80d372, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:53:50,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,877 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112824ac7ad271674d2aa476c3c4476658d2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112824ac7ad271674d2aa476c3c4476658d2 2023-03-14 10:53:50,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:50,890 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:53:50,891 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:53:50,900 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:53:50,901 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:53:50,912 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ca312d2a20db47338376d656e988c6fe first=Optional[r05] last=Optional[r8] 2023-03-14 10:53:50,913 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ca312d2a20db47338376d656e988c6fe}] 2023-03-14 10:53:50,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ca312d2a20db47338376d656e988c6fe for inclusion in 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:50,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 10:53:50,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:53:50,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:53:50,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ca312d2a20db47338376d656e988c6fe to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fv42roa4ecfafo7199md56ufvncs0i53jds71sf424le6nuq37skdisl295hdb8m/family1/ca312d2a20db47338376d656e988c6fe 2023-03-14 10:53:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fv42roa4ecfafo7199md56ufvncs0i53jds71sf424le6nuq37skdisl295hdb8m/family1/ca312d2a20db47338376d656e988c6fe as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/03dc61afb47d4bad986559f61bb1612e_SeqId_53_ 2023-03-14 10:53:50,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fv42roa4ecfafo7199md56ufvncs0i53jds71sf424le6nuq37skdisl295hdb8m/family1/ca312d2a20db47338376d656e988c6fe into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/03dc61afb47d4bad986559f61bb1612e_SeqId_53_ - updating store file list. 2023-03-14 10:53:50,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/03dc61afb47d4bad986559f61bb1612e_SeqId_53_ into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 2023-03-14 10:53:50,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fv42roa4ecfafo7199md56ufvncs0i53jds71sf424le6nuq37skdisl295hdb8m/family1/ca312d2a20db47338376d656e988c6fe into 77adcadf2f1c695c5ad4e92d97a5ed5d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/family1/03dc61afb47d4bad986559f61bb1612e_SeqId_53_) 2023-03-14 10:53:50,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fv42roa4ecfafo7199md56ufvncs0i53jds71sf424le6nuq37skdisl295hdb8m/family1/ca312d2a20db47338376d656e988c6fe 2023-03-14 10:53:50,936 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:50,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:53:50,938 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120d0222291ca114a088dca4c7e73df8ca5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120d0222291ca114a088dca4c7e73df8ca5 2023-03-14 10:53:50,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511286ecf1f11b96340d6a82175105cb1240f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511286ecf1f11b96340d6a82175105cb1240f 2023-03-14 10:53:50,940 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-14 10:53:50,940 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 10:53:50,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 10:53:50,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 10:53:50,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:53:50,941 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 10:53:50,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 107 msec 2023-03-14 10:53:51,042 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 211) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53102 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x2b7ae3ec-SendThread(127.0.0.1:58692) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53048 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:36455-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53020 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49b8a9a2-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53144 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53196 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53210 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x11c71955-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53288 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b930c8d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b930c8d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x2b7ae3ec-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x49b8a9a2-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49b8a9a2-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x2b7ae3ec sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/715920721.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1391280530_15 at /127.0.0.1:53088 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49b8a9a2-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x11c71955-SendThread(127.0.0.1:58692) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53140 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53190 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53160 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49b8a9a2-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:52990 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x11c71955 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/715920721.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53220 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2b930c8d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53110 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:53074 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=594 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=339 (was 356), ProcessCount=169 (was 169), AvailableMemoryMB=2839 (was 3111) 2023-03-14 10:53:51,057 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=339, ProcessCount=169, AvailableMemoryMB=2837 2023-03-14 10:53:51,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 10:53:51,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:51,063 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:53:51,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-14 10:53:51,065 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:53:51,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 10:53:51,067 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,067 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101 empty. 2023-03-14 10:53:51,068 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,068 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-14 10:53:51,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 10:53:51,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 10:53:51,482 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 10:53:51,484 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc8c0d8d794d34832e277dc0ec7d3101, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:53:51,494 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:51,495 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing cc8c0d8d794d34832e277dc0ec7d3101, disabling compactions & flushes 2023-03-14 10:53:51,495 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,495 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,495 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. after waiting 0 ms 2023-03-14 10:53:51,495 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,495 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,495 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:51,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:53:51,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791231499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791231499"}]},"ts":"1678791231499"} 2023-03-14 10:53:51,502 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:53:51,503 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:53:51,503 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791231503"}]},"ts":"1678791231503"} 2023-03-14 10:53:51,505 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-14 10:53:51,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cc8c0d8d794d34832e277dc0ec7d3101, ASSIGN}] 2023-03-14 10:53:51,511 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cc8c0d8d794d34832e277dc0ec7d3101, ASSIGN 2023-03-14 10:53:51,511 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cc8c0d8d794d34832e277dc0ec7d3101, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:53:51,663 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cc8c0d8d794d34832e277dc0ec7d3101, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:51,663 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791231662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791231662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791231662"}]},"ts":"1678791231662"} 2023-03-14 10:53:51,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure cc8c0d8d794d34832e277dc0ec7d3101, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:53:51,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 10:53:51,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc8c0d8d794d34832e277dc0ec7d3101, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:53:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:53:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,823 INFO [StoreOpener-cc8c0d8d794d34832e277dc0ec7d3101-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,825 DEBUG [StoreOpener-cc8c0d8d794d34832e277dc0ec7d3101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:53:51,825 DEBUG [StoreOpener-cc8c0d8d794d34832e277dc0ec7d3101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:53:51,825 INFO [StoreOpener-cc8c0d8d794d34832e277dc0ec7d3101-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc8c0d8d794d34832e277dc0ec7d3101 columnFamilyName family1 2023-03-14 10:53:51,827 INFO [StoreOpener-cc8c0d8d794d34832e277dc0ec7d3101-1] regionserver.HStore(310): Store=cc8c0d8d794d34832e277dc0ec7d3101/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:53:51,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:53:51,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:53:51,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc8c0d8d794d34832e277dc0ec7d3101; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64230270, jitterRate=-0.0428943932056427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:53:51,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:51,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., pid=21, masterSystemTime=1678791231817 2023-03-14 10:53:51,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:51,838 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cc8c0d8d794d34832e277dc0ec7d3101, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:51,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791231838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791231838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791231838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791231838"}]},"ts":"1678791231838"} 2023-03-14 10:53:51,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-14 10:53:51,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure cc8c0d8d794d34832e277dc0ec7d3101, server=jenkins-hbase4.apache.org,36455,1678791214611 in 174 msec 2023-03-14 10:53:51,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-14 10:53:51,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=cc8c0d8d794d34832e277dc0ec7d3101, ASSIGN in 332 msec 2023-03-14 10:53:51,844 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:53:51,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791231844"}]},"ts":"1678791231844"} 2023-03-14 10:53:51,846 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-14 10:53:51,848 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:53:51,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 788 msec 2023-03-14 10:53:52,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 10:53:52,171 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-14 10:53:52,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:52,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,206 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:52,206 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:52,207 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:52,207 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:52,207 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,207 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,208 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:52,208 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:52,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,210 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:52,210 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:52,211 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:52,211 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:52,211 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:52,211 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:52,211 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:52,211 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:53:52,638 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130405a555f702b47d1acfd0795b99c4088 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130405a555f702b47d1acfd0795b99c4088 2023-03-14 10:53:52,643 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/f782f65a99e44fe1bfaacf9c84e219a0 2023-03-14 10:53:52,650 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/f782f65a99e44fe1bfaacf9c84e219a0 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0 2023-03-14 10:53:52,656 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-14 10:53:52,658 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 446ms, sequenceid=5, compaction requested=false 2023-03-14 10:53:52,658 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:52,659 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:52,659 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:52,659 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:52,660 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,660 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:52,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:52,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:52,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:52,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4ec26b[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:52,663 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:52,663 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,664 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,664 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:52,668 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:52,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:52,673 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:52,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:52,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:52,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,673 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:52,678 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,678 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,678 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:52,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,680 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:52,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,686 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,686 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:52,686 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,687 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:52,687 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:52,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:52,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:52,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:52,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:52,687 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,688 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,688 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,688 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,688 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:52,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:52,688 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:52,789 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:52,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:52,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,798 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:52,798 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:52,799 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:52,799 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:52,799 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,799 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,800 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,801 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:52,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:52,801 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:52,801 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,802 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,802 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:52,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:52,802 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:52,802 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:52,803 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:52,803 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:52,803 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:53:53,219 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ab42566ade9a44afaf05925f1a027242 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab42566ade9a44afaf05925f1a027242 2023-03-14 10:53:53,625 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/33a366326f3b450797c037b04eb8e209 2023-03-14 10:53:53,632 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/33a366326f3b450797c037b04eb8e209 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209 2023-03-14 10:53:53,639 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:53:53,640 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 837ms, sequenceid=9, compaction requested=false 2023-03-14 10:53:53,640 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:53,640 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:53,715 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:53,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:53,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,716 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:53,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:53,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62d90d2b[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:53,717 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:53,717 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,777 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:53,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:53,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:53,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:53,819 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:53,819 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:53,819 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:53,819 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,819 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:53,838 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,838 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:53,838 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:53,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,840 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,915 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:53,915 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:53,915 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:53,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:53,915 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,915 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:53,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:53,916 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:53,917 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:54,017 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:54,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:54,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:54,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:54,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,025 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:54,025 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:54,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:54,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:54,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,027 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,027 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:54,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:54,028 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,028 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:54,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,029 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:54,029 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:54,029 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:54,030 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:54,030 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:54,030 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:54,030 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:54,030 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:54,446 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120189b8177d3e8340cabb737e28fe73537f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120189b8177d3e8340cabb737e28fe73537f 2023-03-14 10:53:54,852 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/e618dfc2f1d64a649b56e43cc83d646d 2023-03-14 10:53:54,859 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/e618dfc2f1d64a649b56e43cc83d646d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d 2023-03-14 10:53:54,864 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 10:53:54,865 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 835ms, sequenceid=13, compaction requested=true 2023-03-14 10:53:54,865 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:54,865 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:54,865 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:54,865 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:54,865 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,865 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:54,865 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:54,867 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,867 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:54,867 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,867 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:54,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:54,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f70739e[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:54,869 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:54,869 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,870 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:54,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:54,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:54,870 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,870 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:54,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:54,873 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:54,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:54,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:54,876 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:54,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:54,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:54,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,876 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:54,877 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,877 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:54,878 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:54,878 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,879 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:54,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:54,882 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:54,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:54,883 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:54,883 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,883 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:54,883 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,983 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:54,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:54,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:54,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:54,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,992 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:54,992 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:54,993 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:54,993 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:54,993 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,993 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,995 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,995 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:54,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:54,995 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:54,995 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,996 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,996 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:54,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:54,996 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:54,996 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:54,997 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:54,997 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:54,997 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:54,997 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:54,997 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:54,997 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:55,414 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120558caa1f9ab544d11a04b22a2cc97dded to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120558caa1f9ab544d11a04b22a2cc97dded 2023-03-14 10:53:55,821 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/1e5e477b596a4ca8ab666f8f7f7e1abc 2023-03-14 10:53:55,828 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/1e5e477b596a4ca8ab666f8f7f7e1abc as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc 2023-03-14 10:53:55,833 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 10:53:55,834 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 837ms, sequenceid=17, compaction requested=true 2023-03-14 10:53:55,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:55,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:55,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:55,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:55,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:55,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:55,837 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,837 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:55,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48a67c8[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:55,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:55,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,841 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,841 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:55,841 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:55,841 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:55,841 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,841 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:55,842 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:55,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:55,846 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:55,846 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:55,846 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:55,846 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,846 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:55,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:55,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:55,849 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,850 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,853 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,853 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,853 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,853 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:55,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:55,854 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:55,854 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:55,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:53:55,854 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:55,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:55,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:55,854 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,855 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,855 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,855 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:55,855 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:55,955 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:55,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:55,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:55,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:55,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,977 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:55,977 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:55,978 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:55,978 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:55,979 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,979 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,980 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:55,980 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:55,980 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:55,981 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,982 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:55,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:55,982 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:55,983 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:55,983 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:55,999 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280a20b8a4e7d74a138619fd4a4f91aa01 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512280a20b8a4e7d74a138619fd4a4f91aa01 2023-03-14 10:53:56,005 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/b9189247aacb4b4e90be52f6e54c1b5d 2023-03-14 10:53:56,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:53:56,012 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/b9189247aacb4b4e90be52f6e54c1b5d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d 2023-03-14 10:53:56,020 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 10:53:56,021 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 38ms, sequenceid=21, compaction requested=true 2023-03-14 10:53:56,021 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:56,021 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:56,021 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:56,021 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:56,021 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,021 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:56,021 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:56,023 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,023 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:56,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:56,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:56,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:56,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ffca0a8[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:56,033 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:56,033 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,034 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:56,035 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:56,035 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:56,035 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,035 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:56,037 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:56,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:56,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:56,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:56,041 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:56,041 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:56,041 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:56,041 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,041 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:56,049 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,049 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:56,049 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:56,051 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,052 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:56,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:56,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:56,055 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,056 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,055 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:56,056 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:56,056 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:56,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:56,157 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:56,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:56,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,165 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:56,165 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:56,166 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:56,166 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:56,166 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,166 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,168 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,168 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:56,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:56,169 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:56,169 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,170 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:56,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:56,171 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:56,171 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:56,171 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:56,171 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:56,171 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:56,171 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:56,587 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e53f14d36dca4e788645b2ba942bc38f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e53f14d36dca4e788645b2ba942bc38f 2023-03-14 10:53:56,994 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/6241996df5be4aa497296b80f23c7166 2023-03-14 10:53:57,002 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/6241996df5be4aa497296b80f23c7166 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166 2023-03-14 10:53:57,009 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 10:53:57,010 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 839ms, sequenceid=25, compaction requested=true 2023-03-14 10:53:57,010 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:57,010 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:57,010 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:57,010 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:57,010 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,010 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:57,010 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:57,012 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,012 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:57,012 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,012 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:57,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:57,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:57,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5664029[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:57,014 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:57,014 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,015 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:57,015 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:57,015 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:57,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:57,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:57,017 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:57,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:57,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:57,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:57,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:57,020 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:57,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:57,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:57,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,020 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:57,022 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,022 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:57,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:57,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,022 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:57,023 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:57,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:57,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:57,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:57,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:57,027 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,027 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,027 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:53:57,028 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:57,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:57,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:57,028 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:57,128 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:57,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:57,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:57,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:57,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,148 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:57,148 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:57,148 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:57,148 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:57,149 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,149 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,151 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:57,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:57,151 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,152 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:57,152 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:57,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,152 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,156 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:57,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:57,156 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:57,156 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:57,157 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:57,168 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:57,168 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:57,168 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:57,168 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:57,596 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c05f30c64d9748c08803980c7c6f7ee7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c05f30c64d9748c08803980c7c6f7ee7 2023-03-14 10:53:58,002 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/7b82ad105ef34a87864d63950648f2db 2023-03-14 10:53:58,009 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/7b82ad105ef34a87864d63950648f2db as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db 2023-03-14 10:53:58,016 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 10:53:58,017 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 849ms, sequenceid=29, compaction requested=true 2023-03-14 10:53:58,017 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:58,017 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:58,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:58,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:58,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,018 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:58,018 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:58,019 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,019 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,020 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,020 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:58,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c62f98[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:58,021 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:58,022 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,024 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:58,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:58,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:58,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:58,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:58,029 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:58,029 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:58,029 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:58,029 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,029 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:58,031 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,031 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,031 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:58,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,032 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:58,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:58,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,033 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:58,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:58,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:58,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:58,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:58,037 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:58,037 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:58,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:58,037 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,038 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,038 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:58,038 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:58,138 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:58,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:58,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,149 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:58,149 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:58,150 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:58,150 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:58,150 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,151 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,155 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,155 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:58,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:58,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:58,156 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,156 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:58,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:58,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:58,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,157 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:58,157 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:58,160 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:58,160 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:58,160 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:58,160 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:58,160 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:58,179 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035aac4ab02b0e47ec867c91ebd212d51c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601035aac4ab02b0e47ec867c91ebd212d51c 2023-03-14 10:53:58,592 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/7b0fcf4247ec40488ae862be6567b587 2023-03-14 10:53:58,598 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/7b0fcf4247ec40488ae862be6567b587 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587 2023-03-14 10:53:58,604 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 10:53:58,605 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 445ms, sequenceid=33, compaction requested=true 2023-03-14 10:53:58,605 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:58,605 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:58,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:58,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:58,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:58,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:58,607 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,608 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,608 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:58,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e25b54f[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:58,610 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:58,610 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,611 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,611 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:58,611 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:58,611 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:58,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:58,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:58,616 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,617 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:58,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:58,620 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:58,621 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:58,621 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:58,621 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,621 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:58,622 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,622 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:58,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,622 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:58,623 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,625 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,627 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:58,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:58,628 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:58,627 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:58,628 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:58,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:53:58,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:58,628 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:58,629 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:58,629 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:58,729 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:58,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:58,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:58,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,739 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:58,739 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:58,739 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:58,739 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:58,740 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,740 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,741 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,741 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:58,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:58,741 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:58,741 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,742 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,742 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:58,743 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:58,743 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:58,743 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:58,743 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:58,743 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:58,743 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:58,743 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:58,743 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:53:59,164 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907061f09e5f82d49408e8ae8a2347b1bf6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907061f09e5f82d49408e8ae8a2347b1bf6 2023-03-14 10:53:59,570 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/0266e2d8f122413f9c3c54aa0f3074b0 2023-03-14 10:53:59,576 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/0266e2d8f122413f9c3c54aa0f3074b0 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0 2023-03-14 10:53:59,582 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 10:53:59,583 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 840ms, sequenceid=37, compaction requested=true 2023-03-14 10:53:59,583 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:53:59,583 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:53:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:53:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,583 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:53:59,584 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:53:59,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,586 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:59,586 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,586 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:59,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:53:59,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5416afc3[Count = 0] remaining members to acquire global barrier 2023-03-14 10:53:59,587 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:53:59,587 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,588 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,589 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:53:59,589 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:53:59,589 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,589 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:53:59,589 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:53:59,590 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:53:59,590 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,590 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:59,591 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:53:59,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:53:59,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:53:59,593 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:53:59,593 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:53:59,593 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:53:59,594 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,594 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:53:59,596 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,596 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,596 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:53:59,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:53:59,597 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:53:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,601 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,601 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,601 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:59,601 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:53:59,601 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:53:59,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:59,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:59,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:59,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:53:59,601 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:53:59,602 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:53:59,702 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:53:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:53:59,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:53:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:53:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,710 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:53:59,710 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:59,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:53:59,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:53:59,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,712 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:53:59,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:53:59,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:53:59,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:53:59,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:53:59,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,713 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:53:59,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:53:59,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:53:59,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:53:59,715 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:53:59,715 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. started... 2023-03-14 10:53:59,715 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cc8c0d8d794d34832e277dc0ec7d3101 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:00,130 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120126eb1e84a8848cd962780f8da341b94 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120126eb1e84a8848cd962780f8da341b94 2023-03-14 10:54:00,537 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/1e9f0cd5ba6e49f7af22f1c982de959a 2023-03-14 10:54:00,543 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/1e9f0cd5ba6e49f7af22f1c982de959a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a 2023-03-14 10:54:00,548 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 10:54:00,549 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cc8c0d8d794d34832e277dc0ec7d3101 in 834ms, sequenceid=41, compaction requested=true 2023-03-14 10:54:00,549 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:00,549 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:54:00,550 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:00,550 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:00,550 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,550 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:54:00,550 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:54:00,551 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,551 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:00,552 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,552 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:00,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:54:00,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6346da60[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:00,553 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:00,553 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,555 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:54:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:00,555 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,556 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:00,557 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:54:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:00,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:00,560 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:54:00,560 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:00,560 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:00,560 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,560 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:00,562 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,562 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,562 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:00,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,562 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:00,563 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:00,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,566 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:00,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 10:54:00,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:00,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:00,567 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:00,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:00,567 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:54:00,567 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:00,567 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,568 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:00,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:00,568 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:00,668 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:00,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:00,670 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-14 10:54:00,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:00,673 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:00,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:00,674 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791840674 2023-03-14 10:54:00,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:00,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-14 10:54:00,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:00,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x6de7c883 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:00,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21b09d0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:00,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:01,515 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e981da0e926d4aeba106ea6b6bc465fc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e981da0e926d4aeba106ea6b6bc465fc 2023-03-14 10:54:01,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:01,530 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:01,531 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:01,538 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:01,539 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43358, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:01,550 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a923e3d305a94336a86f1cf15a5aa3e6 first=Optional[r5] last=Optional[r6] 2023-03-14 10:54:01,551 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a923e3d305a94336a86f1cf15a5aa3e6}] 2023-03-14 10:54:01,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a923e3d305a94336a86f1cf15a5aa3e6 for inclusion in cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:01,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-14 10:54:01,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:01,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:01,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a923e3d305a94336a86f1cf15a5aa3e6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jhuhr94falpln0b2vf5lrrr93nr57qa2vphm77bsejktk24jliqg5sd8lfeji3e2/family1/a923e3d305a94336a86f1cf15a5aa3e6 2023-03-14 10:54:01,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jhuhr94falpln0b2vf5lrrr93nr57qa2vphm77bsejktk24jliqg5sd8lfeji3e2/family1/a923e3d305a94336a86f1cf15a5aa3e6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_ 2023-03-14 10:54:01,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jhuhr94falpln0b2vf5lrrr93nr57qa2vphm77bsejktk24jliqg5sd8lfeji3e2/family1/a923e3d305a94336a86f1cf15a5aa3e6 into cc8c0d8d794d34832e277dc0ec7d3101/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_ - updating store file list. 2023-03-14 10:54:01,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_ into cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:01,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jhuhr94falpln0b2vf5lrrr93nr57qa2vphm77bsejktk24jliqg5sd8lfeji3e2/family1/a923e3d305a94336a86f1cf15a5aa3e6 into cc8c0d8d794d34832e277dc0ec7d3101/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_) 2023-03-14 10:54:01,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jhuhr94falpln0b2vf5lrrr93nr57qa2vphm77bsejktk24jliqg5sd8lfeji3e2/family1/a923e3d305a94336a86f1cf15a5aa3e6 2023-03-14 10:54:01,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:54:01,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:54:01,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): cc8c0d8d794d34832e277dc0ec7d3101/family1 is initiating minor compaction 2023-03-14 10:54:01,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@39ca4adc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:01,573 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cc8c0d8d794d34832e277dc0ec7d3101/family1 in testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:54:01,573 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp, totalSize=49.7 K 2023-03-14 10:54:01,573 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 33a366326f3b450797c037b04eb8e209, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:54:01,573 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting e618dfc2f1d64a649b56e43cc83d646d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:54:01,573 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 1e5e477b596a4ca8ab666f8f7f7e1abc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:54:01,573 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b9189247aacb4b4e90be52f6e54c1b5d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 6241996df5be4aa497296b80f23c7166, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 7b82ad105ef34a87864d63950648f2db, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 7b0fcf4247ec40488ae862be6567b587, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 0266e2d8f122413f9c3c54aa0f3074b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 1e9f0cd5ba6e49f7af22f1c982de959a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:54:01,574 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 54b3aab4e22543b887245661a1e82eac_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:54:01,575 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:01,576 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:01,578 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c05f30c64d9748c08803980c7c6f7ee7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c05f30c64d9748c08803980c7c6f7ee7 2023-03-14 10:54:01,579 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601035aac4ab02b0e47ec867c91ebd212d51c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601035aac4ab02b0e47ec867c91ebd212d51c 2023-03-14 10:54:01,579 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-14 10:54:01,579 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-14 10:54:01,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:01,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:01,613 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): cc8c0d8d794d34832e277dc0ec7d3101#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:02,432 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/5e101388ab8648a6a18f2f452d444301 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/5e101388ab8648a6a18f2f452d444301 2023-03-14 10:54:02,436 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316f5570e8d7364a61a1e1b7a87c512bd9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512316f5570e8d7364a61a1e1b7a87c512bd9 2023-03-14 10:54:02,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:02,438 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cc8c0d8d794d34832e277dc0ec7d3101/family1 of cc8c0d8d794d34832e277dc0ec7d3101 into 5e101388ab8648a6a18f2f452d444301(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:02,438 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:02,438 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678791241573; duration=0sec 2023-03-14 10:54:02,438 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:02,462 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/acf9086029bd48ac8ddf39ad26c2a348 first=Optional[r1] last=Optional[r4] 2023-03-14 10:54:02,462 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/acf9086029bd48ac8ddf39ad26c2a348}] 2023-03-14 10:54:02,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/acf9086029bd48ac8ddf39ad26c2a348 for inclusion in cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:02,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-14 10:54:02,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:02,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:02,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/acf9086029bd48ac8ddf39ad26c2a348 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qckuogjpscenrd5dhouasa7fdllmt0n7jplj6d14ti4ta0bu85gm3jqprndojueh/family1/acf9086029bd48ac8ddf39ad26c2a348 2023-03-14 10:54:02,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qckuogjpscenrd5dhouasa7fdllmt0n7jplj6d14ti4ta0bu85gm3jqprndojueh/family1/acf9086029bd48ac8ddf39ad26c2a348 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_ 2023-03-14 10:54:02,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qckuogjpscenrd5dhouasa7fdllmt0n7jplj6d14ti4ta0bu85gm3jqprndojueh/family1/acf9086029bd48ac8ddf39ad26c2a348 into cc8c0d8d794d34832e277dc0ec7d3101/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_ - updating store file list. 2023-03-14 10:54:02,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_ into cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:02,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qckuogjpscenrd5dhouasa7fdllmt0n7jplj6d14ti4ta0bu85gm3jqprndojueh/family1/acf9086029bd48ac8ddf39ad26c2a348 into cc8c0d8d794d34832e277dc0ec7d3101/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_) 2023-03-14 10:54:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qckuogjpscenrd5dhouasa7fdllmt0n7jplj6d14ti4ta0bu85gm3jqprndojueh/family1/acf9086029bd48ac8ddf39ad26c2a348 2023-03-14 10:54:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:54:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:54:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): cc8c0d8d794d34832e277dc0ec7d3101/family1 is initiating minor compaction (all files) 2023-03-14 10:54:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b7d265b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:02,477 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cc8c0d8d794d34832e277dc0ec7d3101/family1 in testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:54:02,477 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/5e101388ab8648a6a18f2f452d444301, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp, totalSize=178.1 K 2023-03-14 10:54:02,478 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting f782f65a99e44fe1bfaacf9c84e219a0, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:54:02,478 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 5e101388ab8648a6a18f2f452d444301, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:54:02,479 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 12645517f4814251b5a72c443452c601_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237821 2023-03-14 10:54:02,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:02,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:02,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120189b8177d3e8340cabb737e28fe73537f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120189b8177d3e8340cabb737e28fe73537f 2023-03-14 10:54:02,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120558caa1f9ab544d11a04b22a2cc97dded to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120558caa1f9ab544d11a04b22a2cc97dded 2023-03-14 10:54:02,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512280a20b8a4e7d74a138619fd4a4f91aa01 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512280a20b8a4e7d74a138619fd4a4f91aa01 2023-03-14 10:54:02,486 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e53f14d36dca4e788645b2ba942bc38f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e53f14d36dca4e788645b2ba942bc38f 2023-03-14 10:54:02,486 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-14 10:54:02,486 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-14 10:54:02,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:02,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:02,498 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): cc8c0d8d794d34832e277dc0ec7d3101#family1#compaction#23 average throughput is 14.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:02,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_] to archive 2023-03-14 10:54:02,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:02,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/33a366326f3b450797c037b04eb8e209 2023-03-14 10:54:02,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/e618dfc2f1d64a649b56e43cc83d646d 2023-03-14 10:54:02,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e5e477b596a4ca8ab666f8f7f7e1abc 2023-03-14 10:54:02,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/b9189247aacb4b4e90be52f6e54c1b5d 2023-03-14 10:54:02,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/6241996df5be4aa497296b80f23c7166 2023-03-14 10:54:02,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b82ad105ef34a87864d63950648f2db 2023-03-14 10:54:02,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/7b0fcf4247ec40488ae862be6567b587 2023-03-14 10:54:02,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0266e2d8f122413f9c3c54aa0f3074b0 2023-03-14 10:54:02,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/1e9f0cd5ba6e49f7af22f1c982de959a 2023-03-14 10:54:02,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/54b3aab4e22543b887245661a1e82eac_SeqId_44_ 2023-03-14 10:54:03,344 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130db05f712d8a743ec97009f816789ffbd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130db05f712d8a743ec97009f816789ffbd 2023-03-14 10:54:03,345 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:03,372 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b91d015a4c0947b7bdadec65823f3753 first=Optional[r00] last=Optional[r8] 2023-03-14 10:54:03,373 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b91d015a4c0947b7bdadec65823f3753}] 2023-03-14 10:54:03,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b91d015a4c0947b7bdadec65823f3753 for inclusion in cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:03,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-14 10:54:03,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:03,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:03,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b91d015a4c0947b7bdadec65823f3753 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r4ho0oapn9ru8t4dqnismmmjd33t8dithuhp3hc7629o5c7mflq9u57n9k607qj7/family1/b91d015a4c0947b7bdadec65823f3753 2023-03-14 10:54:03,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r4ho0oapn9ru8t4dqnismmmjd33t8dithuhp3hc7629o5c7mflq9u57n9k607qj7/family1/b91d015a4c0947b7bdadec65823f3753 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/bfeabb3cab414eb990fa485f5c9b0f64_SeqId_49_ 2023-03-14 10:54:03,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r4ho0oapn9ru8t4dqnismmmjd33t8dithuhp3hc7629o5c7mflq9u57n9k607qj7/family1/b91d015a4c0947b7bdadec65823f3753 into cc8c0d8d794d34832e277dc0ec7d3101/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/bfeabb3cab414eb990fa485f5c9b0f64_SeqId_49_ - updating store file list. 2023-03-14 10:54:03,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/bfeabb3cab414eb990fa485f5c9b0f64_SeqId_49_ into cc8c0d8d794d34832e277dc0ec7d3101/family1 2023-03-14 10:54:03,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r4ho0oapn9ru8t4dqnismmmjd33t8dithuhp3hc7629o5c7mflq9u57n9k607qj7/family1/b91d015a4c0947b7bdadec65823f3753 into cc8c0d8d794d34832e277dc0ec7d3101/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/bfeabb3cab414eb990fa485f5c9b0f64_SeqId_49_) 2023-03-14 10:54:03,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__r4ho0oapn9ru8t4dqnismmmjd33t8dithuhp3hc7629o5c7mflq9u57n9k607qj7/family1/b91d015a4c0947b7bdadec65823f3753 2023-03-14 10:54:03,388 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:03,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:03,391 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120126eb1e84a8848cd962780f8da341b94 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120126eb1e84a8848cd962780f8da341b94 2023-03-14 10:54:03,392 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab42566ade9a44afaf05925f1a027242 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab42566ade9a44afaf05925f1a027242 2023-03-14 10:54:03,393 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130405a555f702b47d1acfd0795b99c4088 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130405a555f702b47d1acfd0795b99c4088 2023-03-14 10:54:03,393 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-14 10:54:03,393 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 10:54:03,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:03,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:03,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:54:03,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:54:03,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:03,395 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:03,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7240 sec 2023-03-14 10:54:03,502 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=256 (was 250) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41270 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41144 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41262 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41314 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41354 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41136 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x6de7c883-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41280 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/0b622466cb3a41f1885d1db645fef4b2 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41250 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41214 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41300 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12f40ad1-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41332 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x6de7c883-SendThread(127.0.0.1:58692) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41318 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1391280530_15 at /127.0.0.1:41302 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58692@0x6de7c883 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/715920721.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1391280530_15 at /127.0.0.1:41164 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12f40ad1-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41146 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-386335016_15 at /127.0.0.1:41312 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=614 (was 594) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 339), ProcessCount=169 (was 169), AvailableMemoryMB=3292 (was 2837) - AvailableMemoryMB LEAK? - 2023-03-14 10:54:03,515 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=169, AvailableMemoryMB=3291 2023-03-14 10:54:03,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:54:03,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:03,520 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:54:03,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-14 10:54:03,521 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:54:03,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:03,523 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:03,523 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1 empty. 2023-03-14 10:54:03,524 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:03,524 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-14 10:54:03,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:03,726 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/.tmp/family1/0b622466cb3a41f1885d1db645fef4b2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/0b622466cb3a41f1885d1db645fef4b2 2023-03-14 10:54:03,732 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cc8c0d8d794d34832e277dc0ec7d3101/family1 of cc8c0d8d794d34832e277dc0ec7d3101 into 0b622466cb3a41f1885d1db645fef4b2(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:54:03,732 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:54:03,732 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678791242477; duration=1sec 2023-03-14 10:54:03,733 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:03,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:03,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/5e101388ab8648a6a18f2f452d444301, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_] to archive 2023-03-14 10:54:03,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:03,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/f782f65a99e44fe1bfaacf9c84e219a0 2023-03-14 10:54:03,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/5e101388ab8648a6a18f2f452d444301 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/5e101388ab8648a6a18f2f452d444301 2023-03-14 10:54:03,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/family1/12645517f4814251b5a72c443452c601_SeqId_47_ 2023-03-14 10:54:03,933 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:03,935 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b4d830d045ae17cad3dab593d3566f1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:04,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:04,341 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:04,342 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 0b4d830d045ae17cad3dab593d3566f1, disabling compactions & flushes 2023-03-14 10:54:04,342 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,342 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,342 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. after waiting 0 ms 2023-03-14 10:54:04,342 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,342 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,342 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:04,344 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:54:04,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791244345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791244345"}]},"ts":"1678791244345"} 2023-03-14 10:54:04,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:54:04,348 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:54:04,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791244348"}]},"ts":"1678791244348"} 2023-03-14 10:54:04,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-14 10:54:04,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0b4d830d045ae17cad3dab593d3566f1, ASSIGN}] 2023-03-14 10:54:04,358 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0b4d830d045ae17cad3dab593d3566f1, ASSIGN 2023-03-14 10:54:04,359 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0b4d830d045ae17cad3dab593d3566f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:04,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0b4d830d045ae17cad3dab593d3566f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:04,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791244510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791244510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791244510"}]},"ts":"1678791244510"} 2023-03-14 10:54:04,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 0b4d830d045ae17cad3dab593d3566f1, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:04,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:04,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b4d830d045ae17cad3dab593d3566f1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:04,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:04,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,669 INFO [StoreOpener-0b4d830d045ae17cad3dab593d3566f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,671 DEBUG [StoreOpener-0b4d830d045ae17cad3dab593d3566f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:04,671 DEBUG [StoreOpener-0b4d830d045ae17cad3dab593d3566f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:04,671 INFO [StoreOpener-0b4d830d045ae17cad3dab593d3566f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4d830d045ae17cad3dab593d3566f1 columnFamilyName family1 2023-03-14 10:54:04,672 INFO [StoreOpener-0b4d830d045ae17cad3dab593d3566f1-1] regionserver.HStore(310): Store=0b4d830d045ae17cad3dab593d3566f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:04,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:54:04,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:04,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b4d830d045ae17cad3dab593d3566f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62262826, jitterRate=-0.07221159338951111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:04,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:04,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1., pid=25, masterSystemTime=1678791244664 2023-03-14 10:54:04,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:04,682 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0b4d830d045ae17cad3dab593d3566f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:04,682 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791244682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791244682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791244682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791244682"}]},"ts":"1678791244682"} 2023-03-14 10:54:04,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-14 10:54:04,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 0b4d830d045ae17cad3dab593d3566f1, server=jenkins-hbase4.apache.org,36455,1678791214611 in 171 msec 2023-03-14 10:54:04,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-14 10:54:04,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=0b4d830d045ae17cad3dab593d3566f1, ASSIGN in 329 msec 2023-03-14 10:54:04,688 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:54:04,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791244688"}]},"ts":"1678791244688"} 2023-03-14 10:54:04,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-14 10:54:04,691 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:54:04,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1740 sec 2023-03-14 10:54:05,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 10:54:05,628 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-14 10:54:05,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:05,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,658 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:05,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:05,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:05,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:05,659 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,659 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,660 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:05,660 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:05,660 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,660 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,661 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:05,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:05,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:05,661 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:05,662 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:05,662 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:05,662 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:54:05,684 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300724c6db6e4c4493b563a95d6eda1c49 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511300724c6db6e4c4493b563a95d6eda1c49 2023-03-14 10:54:05,688 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/771a8f6f7d0049eba37112f843fde6f2 2023-03-14 10:54:05,693 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/771a8f6f7d0049eba37112f843fde6f2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2 2023-03-14 10:54:05,698 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-14 10:54:05,699 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 37ms, sequenceid=5, compaction requested=false 2023-03-14 10:54:05,699 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:05,699 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:05,700 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:05,700 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:05,702 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,702 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:05,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:05,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b84937f[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:05,704 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:05,704 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,706 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,706 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:05,706 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:05,706 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:05,706 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,706 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:05,707 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:05,707 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,707 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:05,707 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:05,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:05,711 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:05,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:05,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:05,711 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,711 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:05,712 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,712 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,713 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:05,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:05,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:05,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:05,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,717 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:05,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:05,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,718 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:05,718 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:05,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:05,718 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:05,818 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:05,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:05,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:05,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,826 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:05,826 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:05,826 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:05,826 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:05,826 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,827 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,829 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:05,829 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:05,830 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,830 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:05,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,830 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,831 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:05,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:05,831 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:05,831 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:05,831 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:54:06,247 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b7c75599e8d9433a957eddab88d63ce6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128b7c75599e8d9433a957eddab88d63ce6 2023-03-14 10:54:06,653 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/57413284c6684b3b978b610ddc957f47 2023-03-14 10:54:06,659 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/57413284c6684b3b978b610ddc957f47 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47 2023-03-14 10:54:06,664 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:54:06,665 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 834ms, sequenceid=9, compaction requested=false 2023-03-14 10:54:06,665 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:06,665 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:06,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:06,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:06,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:06,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:06,667 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,667 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:06,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:06,667 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,667 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:06,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:06,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:06,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2838c28d[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:06,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:06,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,670 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:06,670 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:06,670 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:06,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:06,671 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:06,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:06,672 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:06,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:06,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:06,674 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:06,674 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:06,674 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:06,674 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,674 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:06,676 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,676 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:06,676 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:06,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:06,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:06,677 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:06,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,678 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:06,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:06,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:06,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:06,680 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,680 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:06,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:06,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:06,681 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:06,681 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,681 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,681 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,781 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:06,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:06,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:06,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,788 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:06,788 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:06,788 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:06,788 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:06,788 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,788 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,789 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:06,789 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:06,790 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:06,790 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,791 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:06,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:06,791 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:06,791 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:06,791 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:06,791 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:07,224 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120158b760ac4e1441cfaf046f9198d1843d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120158b760ac4e1441cfaf046f9198d1843d 2023-03-14 10:54:07,224 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:07,224 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6de7c883 to 127.0.0.1:58692 2023-03-14 10:54:07,225 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:07,225 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:07,226 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b7ae3ec to 127.0.0.1:58692 2023-03-14 10:54:07,226 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:07,226 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:07,226 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11c71955 to 127.0.0.1:58692 2023-03-14 10:54:07,226 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:07,632 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/a4b284f947cc4550aee19fcb3aef24c8 2023-03-14 10:54:07,638 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/a4b284f947cc4550aee19fcb3aef24c8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8 2023-03-14 10:54:07,642 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 10:54:07,643 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 852ms, sequenceid=13, compaction requested=true 2023-03-14 10:54:07,644 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:07,644 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:07,645 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,645 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:07,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:07,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:07,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@493108fe[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:07,647 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:07,647 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,648 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:07,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:07,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:07,649 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,649 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:07,650 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:07,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:07,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:07,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:07,652 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:07,653 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:07,653 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:07,653 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,653 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:07,658 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,658 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,658 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:07,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:07,660 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:07,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,662 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:07,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:07,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:07,662 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:07,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:07,663 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:07,763 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:07,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:07,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:07,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:07,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,770 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:07,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:07,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:07,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:07,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,771 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,771 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:07,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:07,772 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:07,772 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:07,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:07,773 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:07,773 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:07,773 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:07,773 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:07,773 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:07,773 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:07,773 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:07,773 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:08,186 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fcd0fb9fc5b14e7d82c3545f06697f6a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcd0fb9fc5b14e7d82c3545f06697f6a 2023-03-14 10:54:08,592 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/9648b7f94d1b4cceb503c3617feb6786 2023-03-14 10:54:08,598 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/9648b7f94d1b4cceb503c3617feb6786 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786 2023-03-14 10:54:08,602 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 10:54:08,603 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 830ms, sequenceid=17, compaction requested=true 2023-03-14 10:54:08,603 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:08,603 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:08,603 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:08,605 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,605 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:08,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,606 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c715e62[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:08,607 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:08,607 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,608 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,608 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:08,609 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:08,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:08,610 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:08,610 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,610 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:08,610 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:08,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:08,613 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:08,613 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:08,613 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:08,613 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,613 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:08,614 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,614 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:08,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,614 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:08,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:08,615 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,616 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:08,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,619 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,619 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:08,619 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:08,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:08,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:08,619 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:08,619 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,619 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:08,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,720 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:08,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:08,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:08,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:08,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,727 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:08,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:08,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:08,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:08,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,727 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,729 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:08,729 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:08,729 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:08,729 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,730 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:08,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:08,730 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:08,730 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:08,730 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:09,143 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fd5ecfc9e9b04fd88c69bfa3fede3ee5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd5ecfc9e9b04fd88c69bfa3fede3ee5 2023-03-14 10:54:09,549 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/97f1e208d9324f44af3ceba3b3c88b03 2023-03-14 10:54:09,554 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/97f1e208d9324f44af3ceba3b3c88b03 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03 2023-03-14 10:54:09,558 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 10:54:09,559 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 829ms, sequenceid=21, compaction requested=true 2023-03-14 10:54:09,560 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:09,560 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:09,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:09,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:09,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:09,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:09,561 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:09,562 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,562 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:09,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:09,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23d129f8[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:09,563 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:09,563 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,564 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,564 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:09,564 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:09,564 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:09,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:09,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:09,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:09,566 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:09,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:09,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:09,569 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:09,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:09,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:09,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,569 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:09,570 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,570 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:09,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:09,570 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:09,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,571 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:09,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:09,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,572 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:09,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:09,574 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:09,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:09,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:09,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:09,574 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:09,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:09,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:09,675 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:09,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:09,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:09,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:09,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,682 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:09,682 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:09,682 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:09,682 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:09,682 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,684 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:09,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:09,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:09,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:09,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:09,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:09,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:09,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:09,685 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:09,685 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:09,686 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:09,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:09,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:09,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:09,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:09,687 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:10,101 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cc7716bf8c034060a95f8c8dc10f4249 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc7716bf8c034060a95f8c8dc10f4249 2023-03-14 10:54:10,196 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:54:10,507 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/d449eea63c8c456592366a0ec5f4e2b7 2023-03-14 10:54:10,512 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/d449eea63c8c456592366a0ec5f4e2b7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7 2023-03-14 10:54:10,516 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 10:54:10,517 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 830ms, sequenceid=25, compaction requested=true 2023-03-14 10:54:10,517 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:10,517 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:10,519 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d93bba5[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:10,521 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:10,521 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,522 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,522 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:10,522 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:10,522 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:10,522 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,522 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:10,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,527 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:10,527 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:10,528 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:10,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:10,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:10,530 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:10,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:10,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:10,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,530 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:10,531 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,531 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:10,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,531 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:10,532 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,533 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,534 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:10,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:10,535 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:10,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,635 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:10,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:10,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:10,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:10,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,642 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:10,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:10,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:10,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:10,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,642 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,645 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,645 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:10,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:10,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:10,645 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:10,645 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:10,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:10,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,646 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:10,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:10,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:10,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:10,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:10,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:10,646 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:10,646 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:10,646 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:10,646 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:11,060 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011039791910cc4e968ad04874d43f6765 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011039791910cc4e968ad04874d43f6765 2023-03-14 10:54:11,067 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/c542564a8c404da49a7049e707621b77 2023-03-14 10:54:11,072 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/c542564a8c404da49a7049e707621b77 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77 2023-03-14 10:54:11,079 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 10:54:11,085 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 439ms, sequenceid=29, compaction requested=true 2023-03-14 10:54:11,085 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:11,085 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:11,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:11,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:11,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:11,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:11,087 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,087 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,087 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,087 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:11,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ca42c11[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:11,089 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:11,089 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,090 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,090 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:11,090 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:11,090 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:11,090 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,090 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:11,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:11,091 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:11,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:11,093 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:11,093 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:11,094 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:11,094 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,094 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:11,096 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,096 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,096 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:11,097 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,098 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,100 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:11,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:11,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:11,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:11,100 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:11,101 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,101 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,101 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:11,101 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:11,201 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:11,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:11,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:11,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:11,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,208 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:11,208 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:11,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:11,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:11,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,209 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,210 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:11,210 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:11,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:11,211 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,211 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:11,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:11,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:11,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:11,212 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:11,212 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:11,212 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:11,213 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:11,227 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035aca05711b7342a9b184d064a9f73444 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035aca05711b7342a9b184d064a9f73444 2023-03-14 10:54:11,635 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/d0dbf9d12cff4d13963a0aa7d0243a77 2023-03-14 10:54:11,641 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/d0dbf9d12cff4d13963a0aa7d0243a77 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77 2023-03-14 10:54:11,646 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 10:54:11,647 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 434ms, sequenceid=33, compaction requested=true 2023-03-14 10:54:11,648 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:11,648 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:11,649 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:11,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ab0f1a9[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:11,652 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:11,652 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,653 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,654 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:11,654 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:11,654 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:11,654 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,654 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:11,655 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:11,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:11,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:11,658 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:11,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:11,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:11,658 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,658 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:11,660 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,660 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,660 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:11,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,660 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:11,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,662 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:11,664 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:11,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,664 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:11,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:11,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:11,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:11,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:11,665 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:11,665 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:11,765 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:11,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:11,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:11,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:11,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,773 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:11,774 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:11,774 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:11,774 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:11,774 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,774 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,777 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:11,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:11,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:11,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:11,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:11,779 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:11,779 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:11,779 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:11,779 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:12,193 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079988965f97ae43569248043154aadade to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509079988965f97ae43569248043154aadade 2023-03-14 10:54:12,600 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/ec0fe1c5a10d4bb1805c4eace44cd488 2023-03-14 10:54:12,607 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/ec0fe1c5a10d4bb1805c4eace44cd488 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488 2023-03-14 10:54:12,612 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 10:54:12,613 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 834ms, sequenceid=37, compaction requested=true 2023-03-14 10:54:12,613 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:12,613 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:12,615 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,615 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:12,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@300485ee[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:12,617 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:12,618 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,621 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:12,622 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,622 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:12,623 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,623 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:12,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:12,626 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:12,626 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:12,626 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:12,626 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,626 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:12,629 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,629 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:12,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,629 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,636 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,638 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,640 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:12,640 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:12,640 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:12,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:12,640 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,640 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:12,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:12,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:12,640 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:12,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:12,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:12,641 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:12,741 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:12,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:12,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:12,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:12,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,749 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:12,749 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:12,749 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:12,749 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:12,750 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,750 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,753 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:12,753 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:12,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:12,753 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,753 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:12,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:12,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:12,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,754 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:12,754 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:12,754 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:12,755 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:12,755 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:12,755 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:12,755 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. started... 2023-03-14 10:54:12,755 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b4d830d045ae17cad3dab593d3566f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:12,774 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a59bb0557d844d7dbe998b9e33a260d8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120a59bb0557d844d7dbe998b9e33a260d8 2023-03-14 10:54:12,786 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/3e3ea1ada47742c3a3e815f24f4c91f4 2023-03-14 10:54:12,792 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/3e3ea1ada47742c3a3e815f24f4c91f4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4 2023-03-14 10:54:12,797 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 10:54:12,798 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b4d830d045ae17cad3dab593d3566f1 in 43ms, sequenceid=41, compaction requested=true 2023-03-14 10:54:12,798 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:12,798 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:12,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:12,800 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,801 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,802 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,802 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:12,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@601a5ed8[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:12,803 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:12,803 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,804 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,804 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:12,804 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,804 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:12,804 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:12,805 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:12,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:12,809 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:12,809 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:12,809 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:12,809 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,809 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:12,811 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,811 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:12,811 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:12,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:12,812 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,813 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,815 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:12,815 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:12,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 10:54:12,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:12,816 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:12,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:12,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:12,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:12,817 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,817 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,917 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:12,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:12,919 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-14 10:54:12,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:12,922 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:12,923 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791852923 2023-03-14 10:54:12,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:12,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:54:12,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-14 10:54:12,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x41f27063 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:12,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@640fcdbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:12,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,404 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010367301687fc2d4d00aed61ada351dcfac to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010367301687fc2d4d00aed61ada351dcfac 2023-03-14 10:54:13,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:13,423 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:13,424 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:13,432 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:13,435 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:13,450 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1a81a49271fb4e7eb6783bcbb5478bb5 first=Optional[r3] last=Optional[r6] 2023-03-14 10:54:13,451 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1a81a49271fb4e7eb6783bcbb5478bb5}] 2023-03-14 10:54:13,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1a81a49271fb4e7eb6783bcbb5478bb5 for inclusion in 0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:13,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 10:54:13,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:13,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:13,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1a81a49271fb4e7eb6783bcbb5478bb5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kbjt29lm8s0871fm1e90h267qp1otggjgjdm1jjrmabijfjdv8gimhkl323h33t5/family1/1a81a49271fb4e7eb6783bcbb5478bb5 2023-03-14 10:54:13,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kbjt29lm8s0871fm1e90h267qp1otggjgjdm1jjrmabijfjdv8gimhkl323h33t5/family1/1a81a49271fb4e7eb6783bcbb5478bb5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_ 2023-03-14 10:54:13,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kbjt29lm8s0871fm1e90h267qp1otggjgjdm1jjrmabijfjdv8gimhkl323h33t5/family1/1a81a49271fb4e7eb6783bcbb5478bb5 into 0b4d830d045ae17cad3dab593d3566f1/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_ - updating store file list. 2023-03-14 10:54:13,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_ into 0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:13,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kbjt29lm8s0871fm1e90h267qp1otggjgjdm1jjrmabijfjdv8gimhkl323h33t5/family1/1a81a49271fb4e7eb6783bcbb5478bb5 into 0b4d830d045ae17cad3dab593d3566f1/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_) 2023-03-14 10:54:13,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kbjt29lm8s0871fm1e90h267qp1otggjgjdm1jjrmabijfjdv8gimhkl323h33t5/family1/1a81a49271fb4e7eb6783bcbb5478bb5 2023-03-14 10:54:13,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:54:13,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:54:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 0b4d830d045ae17cad3dab593d3566f1/family1 is initiating minor compaction 2023-03-14 10:54:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@75efe55f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:13,481 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b4d830d045ae17cad3dab593d3566f1/family1 in testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:13,481 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp, totalSize=50.0 K 2023-03-14 10:54:13,481 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 57413284c6684b3b978b610ddc957f47, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:54:13,481 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting a4b284f947cc4550aee19fcb3aef24c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:54:13,481 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 9648b7f94d1b4cceb503c3617feb6786, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:54:13,481 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 97f1e208d9324f44af3ceba3b3c88b03, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d449eea63c8c456592366a0ec5f4e2b7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting c542564a8c404da49a7049e707621b77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d0dbf9d12cff4d13963a0aa7d0243a77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting ec0fe1c5a10d4bb1805c4eace44cd488, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 3e3ea1ada47742c3a3e815f24f4c91f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:54:13,482 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting c10c2b0dbcf34d9da2342916043819c9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:54:13,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:13,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:13,487 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd5ecfc9e9b04fd88c69bfa3fede3ee5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd5ecfc9e9b04fd88c69bfa3fede3ee5 2023-03-14 10:54:13,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc7716bf8c034060a95f8c8dc10f4249 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc7716bf8c034060a95f8c8dc10f4249 2023-03-14 10:54:13,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011039791910cc4e968ad04874d43f6765 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011039791910cc4e968ad04874d43f6765 2023-03-14 10:54:13,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035aca05711b7342a9b184d064a9f73444 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035aca05711b7342a9b184d064a9f73444 2023-03-14 10:54:13,493 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-14 10:54:13,493 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:13,528 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b4d830d045ae17cad3dab593d3566f1#family1#compaction#34 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:13,971 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/888d1733698f4401b0fc3bd0bf5609b7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/888d1733698f4401b0fc3bd0bf5609b7 2023-03-14 10:54:13,977 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0b4d830d045ae17cad3dab593d3566f1/family1 of 0b4d830d045ae17cad3dab593d3566f1 into 888d1733698f4401b0fc3bd0bf5609b7(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:13,977 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:13,977 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678791253481; duration=0sec 2023-03-14 10:54:13,977 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:14,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_] to archive 2023-03-14 10:54:14,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:14,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/57413284c6684b3b978b610ddc957f47 2023-03-14 10:54:14,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/a4b284f947cc4550aee19fcb3aef24c8 2023-03-14 10:54:14,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/9648b7f94d1b4cceb503c3617feb6786 2023-03-14 10:54:14,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/97f1e208d9324f44af3ceba3b3c88b03 2023-03-14 10:54:14,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d449eea63c8c456592366a0ec5f4e2b7 2023-03-14 10:54:14,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c542564a8c404da49a7049e707621b77 2023-03-14 10:54:14,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d0dbf9d12cff4d13963a0aa7d0243a77 2023-03-14 10:54:14,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/ec0fe1c5a10d4bb1805c4eace44cd488 2023-03-14 10:54:14,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/3e3ea1ada47742c3a3e815f24f4c91f4 2023-03-14 10:54:14,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/c10c2b0dbcf34d9da2342916043819c9_SeqId_44_ 2023-03-14 10:54:14,370 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b87b097ffb6e4880856bc726875b80b6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205b87b097ffb6e4880856bc726875b80b6 2023-03-14 10:54:14,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:14,402 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/07f27fd3cff04f24b9d0a722e635ed08 first=Optional[r1] last=Optional[r2] 2023-03-14 10:54:14,402 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/07f27fd3cff04f24b9d0a722e635ed08}] 2023-03-14 10:54:14,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/07f27fd3cff04f24b9d0a722e635ed08 for inclusion in 0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-14 10:54:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:14,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/07f27fd3cff04f24b9d0a722e635ed08 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s52ig94nf8kr5300p9pl3bq749m1ri4nv4ccoon8de2gp5jonhmh1jqfl83e0qi3/family1/07f27fd3cff04f24b9d0a722e635ed08 2023-03-14 10:54:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s52ig94nf8kr5300p9pl3bq749m1ri4nv4ccoon8de2gp5jonhmh1jqfl83e0qi3/family1/07f27fd3cff04f24b9d0a722e635ed08 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_ 2023-03-14 10:54:14,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s52ig94nf8kr5300p9pl3bq749m1ri4nv4ccoon8de2gp5jonhmh1jqfl83e0qi3/family1/07f27fd3cff04f24b9d0a722e635ed08 into 0b4d830d045ae17cad3dab593d3566f1/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_ - updating store file list. 2023-03-14 10:54:14,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_ into 0b4d830d045ae17cad3dab593d3566f1/family1 2023-03-14 10:54:14,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s52ig94nf8kr5300p9pl3bq749m1ri4nv4ccoon8de2gp5jonhmh1jqfl83e0qi3/family1/07f27fd3cff04f24b9d0a722e635ed08 into 0b4d830d045ae17cad3dab593d3566f1/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_) 2023-03-14 10:54:14,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s52ig94nf8kr5300p9pl3bq749m1ri4nv4ccoon8de2gp5jonhmh1jqfl83e0qi3/family1/07f27fd3cff04f24b9d0a722e635ed08 2023-03-14 10:54:14,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:54:14,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:54:14,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 0b4d830d045ae17cad3dab593d3566f1/family1 is initiating minor compaction (all files) 2023-03-14 10:54:14,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1597ece2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:14,424 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b4d830d045ae17cad3dab593d3566f1/family1 in testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:54:14,424 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/888d1733698f4401b0fc3bd0bf5609b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp, totalSize=176.8 K 2023-03-14 10:54:14,425 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 771a8f6f7d0049eba37112f843fde6f2, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:54:14,425 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 888d1733698f4401b0fc3bd0bf5609b7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:54:14,426 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965237821 2023-03-14 10:54:14,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:14,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:14,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120158b760ac4e1441cfaf046f9198d1843d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120158b760ac4e1441cfaf046f9198d1843d 2023-03-14 10:54:14,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcd0fb9fc5b14e7d82c3545f06697f6a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcd0fb9fc5b14e7d82c3545f06697f6a 2023-03-14 10:54:14,431 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-14 10:54:14,431 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 10:54:14,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:14,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:14,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:14,433 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:14,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.5130 sec 2023-03-14 10:54:14,446 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b4d830d045ae17cad3dab593d3566f1#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:14,488 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/.tmp/family1/45d90e5a7a224459acf2ec522996d925 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/45d90e5a7a224459acf2ec522996d925 2023-03-14 10:54:14,495 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0b4d830d045ae17cad3dab593d3566f1/family1 of 0b4d830d045ae17cad3dab593d3566f1 into 45d90e5a7a224459acf2ec522996d925(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:14,495 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:54:14,495 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1678791254424; duration=0sec 2023-03-14 10:54:14,495 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:14,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/888d1733698f4401b0fc3bd0bf5609b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_] to archive 2023-03-14 10:54:14,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:14,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/771a8f6f7d0049eba37112f843fde6f2 2023-03-14 10:54:14,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/888d1733698f4401b0fc3bd0bf5609b7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/888d1733698f4401b0fc3bd0bf5609b7 2023-03-14 10:54:14,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/family1/d2c861cae2b348e8862c6b2aec6d19dd_SeqId_47_ 2023-03-14 10:54:14,553 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=248 (was 256), OpenFileDescriptor=599 (was 614), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 293), ProcessCount=169 (was 169), AvailableMemoryMB=2946 (was 3291) 2023-03-14 10:54:14,569 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=169, AvailableMemoryMB=2932 2023-03-14 10:54:14,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 10:54:14,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:14,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:54:14,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-14 10:54:14,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:14,581 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:54:14,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:14,584 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:14,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd empty. 2023-03-14 10:54:14,584 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:14,588 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874 empty. 2023-03-14 10:54:14,588 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d empty. 2023-03-14 10:54:14,588 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:14,590 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:14,590 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:14,590 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-14 10:54:14,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:14,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:15,008 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:15,010 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9a765a00674054a4a810d05e0c621874, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:15,010 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9edb0c0e65a6948211efc92a242984fd, NAME => 'testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:15,010 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4330ab5c277432d16109867ee596c48d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:15,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 9edb0c0e65a6948211efc92a242984fd, disabling compactions & flushes 2023-03-14 10:54:15,422 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. after waiting 0 ms 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,422 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 9edb0c0e65a6948211efc92a242984fd: 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 4330ab5c277432d16109867ee596c48d, disabling compactions & flushes 2023-03-14 10:54:15,422 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. after waiting 0 ms 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,422 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 9a765a00674054a4a810d05e0c621874, disabling compactions & flushes 2023-03-14 10:54:15,422 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,422 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,423 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. after waiting 0 ms 2023-03-14 10:54:15,423 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,423 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,423 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 9a765a00674054a4a810d05e0c621874: 2023-03-14 10:54:15,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:54:15,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791255426"}]},"ts":"1678791255426"} 2023-03-14 10:54:15,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791255426"}]},"ts":"1678791255426"} 2023-03-14 10:54:15,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678791255426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791255426"}]},"ts":"1678791255426"} 2023-03-14 10:54:15,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 10:54:15,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:54:15,430 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791255430"}]},"ts":"1678791255430"} 2023-03-14 10:54:15,431 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-14 10:54:15,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9edb0c0e65a6948211efc92a242984fd, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9a765a00674054a4a810d05e0c621874, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4330ab5c277432d16109867ee596c48d, ASSIGN}] 2023-03-14 10:54:15,436 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9edb0c0e65a6948211efc92a242984fd, ASSIGN 2023-03-14 10:54:15,436 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9a765a00674054a4a810d05e0c621874, ASSIGN 2023-03-14 10:54:15,436 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4330ab5c277432d16109867ee596c48d, ASSIGN 2023-03-14 10:54:15,436 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9edb0c0e65a6948211efc92a242984fd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:15,436 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9a765a00674054a4a810d05e0c621874, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:15,437 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4330ab5c277432d16109867ee596c48d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:15,588 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4330ab5c277432d16109867ee596c48d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9edb0c0e65a6948211efc92a242984fd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9a765a00674054a4a810d05e0c621874, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,588 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791255588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791255588"}]},"ts":"1678791255588"} 2023-03-14 10:54:15,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791255588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791255588"}]},"ts":"1678791255588"} 2023-03-14 10:54:15,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678791255588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791255588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791255588"}]},"ts":"1678791255588"} 2023-03-14 10:54:15,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 4330ab5c277432d16109867ee596c48d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:15,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 9edb0c0e65a6948211efc92a242984fd, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:15,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 9a765a00674054a4a810d05e0c621874, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:15,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:15,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4330ab5c277432d16109867ee596c48d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 10:54:15,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,748 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,749 DEBUG [StoreOpener-4330ab5c277432d16109867ee596c48d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1 2023-03-14 10:54:15,749 DEBUG [StoreOpener-4330ab5c277432d16109867ee596c48d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1 2023-03-14 10:54:15,750 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4330ab5c277432d16109867ee596c48d columnFamilyName family1 2023-03-14 10:54:15,751 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] regionserver.HStore(310): Store=4330ab5c277432d16109867ee596c48d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,751 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,752 DEBUG [StoreOpener-4330ab5c277432d16109867ee596c48d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family2 2023-03-14 10:54:15,752 DEBUG [StoreOpener-4330ab5c277432d16109867ee596c48d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family2 2023-03-14 10:54:15,753 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4330ab5c277432d16109867ee596c48d columnFamilyName family2 2023-03-14 10:54:15,754 INFO [StoreOpener-4330ab5c277432d16109867ee596c48d-1] regionserver.HStore(310): Store=4330ab5c277432d16109867ee596c48d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:54:15,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4330ab5c277432d16109867ee596c48d 2023-03-14 10:54:15,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:15,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4330ab5c277432d16109867ee596c48d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63033877, jitterRate=-0.06072203814983368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:54:15,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:15,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d., pid=31, masterSystemTime=1678791255742 2023-03-14 10:54:15,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:15,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9edb0c0e65a6948211efc92a242984fd, NAME => 'testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 10:54:15,763 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4330ab5c277432d16109867ee596c48d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,763 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255763"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791255763"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791255763"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791255763"}]},"ts":"1678791255763"} 2023-03-14 10:54:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,765 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,766 DEBUG [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/family1 2023-03-14 10:54:15,766 DEBUG [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/family1 2023-03-14 10:54:15,766 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9edb0c0e65a6948211efc92a242984fd columnFamilyName family1 2023-03-14 10:54:15,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-03-14 10:54:15,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 4330ab5c277432d16109867ee596c48d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 175 msec 2023-03-14 10:54:15,767 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] regionserver.HStore(310): Store=9edb0c0e65a6948211efc92a242984fd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,768 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4330ab5c277432d16109867ee596c48d, ASSIGN in 333 msec 2023-03-14 10:54:15,770 DEBUG [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/family2 2023-03-14 10:54:15,770 DEBUG [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/family2 2023-03-14 10:54:15,770 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9edb0c0e65a6948211efc92a242984fd columnFamilyName family2 2023-03-14 10:54:15,771 INFO [StoreOpener-9edb0c0e65a6948211efc92a242984fd-1] regionserver.HStore(310): Store=9edb0c0e65a6948211efc92a242984fd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:54:15,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:54:15,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:15,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9edb0c0e65a6948211efc92a242984fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61673751, jitterRate=-0.08098949491977692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:54:15,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9edb0c0e65a6948211efc92a242984fd: 2023-03-14 10:54:15,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd., pid=32, masterSystemTime=1678791255742 2023-03-14 10:54:15,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:15,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a765a00674054a4a810d05e0c621874, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 10:54:15,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,782 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9edb0c0e65a6948211efc92a242984fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:15,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,783 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678791255782"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791255782"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791255782"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791255782"}]},"ts":"1678791255782"} 2023-03-14 10:54:15,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,784 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,786 DEBUG [StoreOpener-9a765a00674054a4a810d05e0c621874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/family1 2023-03-14 10:54:15,786 DEBUG [StoreOpener-9a765a00674054a4a810d05e0c621874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/family1 2023-03-14 10:54:15,787 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a765a00674054a4a810d05e0c621874 columnFamilyName family1 2023-03-14 10:54:15,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-14 10:54:15,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 9edb0c0e65a6948211efc92a242984fd, server=jenkins-hbase4.apache.org,36455,1678791214611 in 193 msec 2023-03-14 10:54:15,788 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] regionserver.HStore(310): Store=9a765a00674054a4a810d05e0c621874/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,788 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9edb0c0e65a6948211efc92a242984fd, ASSIGN in 353 msec 2023-03-14 10:54:15,790 DEBUG [StoreOpener-9a765a00674054a4a810d05e0c621874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/family2 2023-03-14 10:54:15,790 DEBUG [StoreOpener-9a765a00674054a4a810d05e0c621874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/family2 2023-03-14 10:54:15,790 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a765a00674054a4a810d05e0c621874 columnFamilyName family2 2023-03-14 10:54:15,791 INFO [StoreOpener-9a765a00674054a4a810d05e0c621874-1] regionserver.HStore(310): Store=9a765a00674054a4a810d05e0c621874/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:15,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:54:15,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a765a00674054a4a810d05e0c621874 2023-03-14 10:54:15,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:15,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a765a00674054a4a810d05e0c621874; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59643458, jitterRate=-0.11124321818351746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:54:15,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a765a00674054a4a810d05e0c621874: 2023-03-14 10:54:15,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874., pid=33, masterSystemTime=1678791255742 2023-03-14 10:54:15,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:15,802 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9a765a00674054a4a810d05e0c621874, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:15,802 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678791255802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791255802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791255802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791255802"}]},"ts":"1678791255802"} 2023-03-14 10:54:15,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-03-14 10:54:15,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 9a765a00674054a4a810d05e0c621874, server=jenkins-hbase4.apache.org,36455,1678791214611 in 211 msec 2023-03-14 10:54:15,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-03-14 10:54:15,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9a765a00674054a4a810d05e0c621874, ASSIGN in 371 msec 2023-03-14 10:54:15,808 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:54:15,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791255808"}]},"ts":"1678791255808"} 2023-03-14 10:54:15,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-14 10:54:15,812 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:54:15,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2400 sec 2023-03-14 10:54:16,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 10:54:16,688 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-14 10:54:16,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:16,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,696 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-14 10:54:16,696 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:16,696 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-14 10:54:16,696 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-14 10:54:16,697 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,697 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,699 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:16,699 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:16,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:16,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:16,699 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:16,699 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:16,701 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-14 10:54:16,701 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:16,701 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-14 10:54:16,701 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:16,701 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. started... 2023-03-14 10:54:16,701 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:54:16,701 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:16,701 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:16,701 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:16,702 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. started... 2023-03-14 10:54:16,702 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4330ab5c277432d16109867ee596c48d 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-14 10:54:16,702 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. started... 2023-03-14 10:54:16,702 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a765a00674054a4a810d05e0c621874: 2023-03-14 10:54:16,703 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9edb0c0e65a6948211efc92a242984fd: 2023-03-14 10:54:16,703 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:16,703 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:16,703 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:54:16,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:54:17,124 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031411e538def6c94cdeb1e16f4803877567 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031411e538def6c94cdeb1e16f4803877567 2023-03-14 10:54:17,529 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp/family1/151dcf5422434f668cc54d37f73d8636 2023-03-14 10:54:17,535 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp/family1/151dcf5422434f668cc54d37f73d8636 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636 2023-03-14 10:54:17,539 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636, entries=1, sequenceid=5, filesize=4.9 K 2023-03-14 10:54:17,540 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 4330ab5c277432d16109867ee596c48d in 838ms, sequenceid=5, compaction requested=false 2023-03-14 10:54:17,540 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-14 10:54:17,541 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:17,541 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:17,541 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:54:17,541 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:54:17,541 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,541 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-14 10:54:17,541 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-14 10:54:17,543 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,543 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:17,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:17,543 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,543 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:17,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:17,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-14 10:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d73326e[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:17,544 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-14 10:54:17,545 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,546 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,546 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-14 10:54:17,546 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-14 10:54:17,546 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,546 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:17,546 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:17,548 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,548 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-14 10:54:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:17,548 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:17,548 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-14 10:54:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:17,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:17,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-14 10:54:17,550 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-14 10:54:17,550 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:17,550 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:17,550 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,550 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:17,553 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,553 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,553 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:17,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:17,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:17,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,553 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:17,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:17,554 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:17,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:17,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-14 10:54:17,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:17,559 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:17,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:17,559 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,560 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:17,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:17,560 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:17,560 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:17,660 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:17,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:17,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:17,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,667 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-14 10:54:17,667 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:17,667 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-14 10:54:17,667 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-14 10:54:17,668 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,668 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,669 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:17,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:17,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:17,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:17,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:17,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,670 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-14 10:54:17,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-14 10:54:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:17,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. started... 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:17,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. started... 2023-03-14 10:54:17,671 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4330ab5c277432d16109867ee596c48d 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. started... 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9edb0c0e65a6948211efc92a242984fd: 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9a765a00674054a4a810d05e0c621874: 2023-03-14 10:54:17,671 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:54:17,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:17,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:54:17,671 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:54:18,087 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314322667f85b5c439eb77294a49872d559 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314322667f85b5c439eb77294a49872d559 2023-03-14 10:54:18,493 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp/family1/21f6a252167b4260b0b1d81056de6ea8 2023-03-14 10:54:18,498 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp/family1/21f6a252167b4260b0b1d81056de6ea8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8 2023-03-14 10:54:18,502 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8, entries=2, sequenceid=9, filesize=5.0 K 2023-03-14 10:54:18,503 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 4330ab5c277432d16109867ee596c48d in 832ms, sequenceid=9, compaction requested=false 2023-03-14 10:54:18,504 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:18,504 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:18,504 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:54:18,504 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:54:18,504 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,504 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-14 10:54:18,504 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-14 10:54:18,507 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,507 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:18,507 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,507 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:18,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-14 10:54:18,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d3afd0[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:18,509 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-14 10:54:18,509 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,510 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,510 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-14 10:54:18,510 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-14 10:54:18,510 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:18,510 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,510 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:18,511 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,511 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-14 10:54:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:18,512 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:18,512 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-14 10:54:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:18,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-14 10:54:18,514 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-14 10:54:18,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:18,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:18,514 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,514 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:18,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:18,516 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:18,516 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:18,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:18,517 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:18,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-14 10:54:18,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:18,521 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:18,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:18,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:18,521 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:18,522 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,522 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,522 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:18,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:18,622 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:18,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:18,629 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-14 10:54:18,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 10:54:18,631 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 10:54:18,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:18,632 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791858632 2023-03-14 10:54:18,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:18,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-14 10:54:18,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 10:54:18,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x063760d7 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:18,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ccf3f92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:18,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-14 10:54:19,467 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031402941f60d5f04d429dbf245bfabf77bf to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031402941f60d5f04d429dbf245bfabf77bf 2023-03-14 10:54:19,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 10:54:19,484 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:19,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:19,493 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:19,496 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:19,505 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/54cf8b1aeabb456daeea1e2652ab211f first=Optional[k0] last=Optional[k1] 2023-03-14 10:54:19,506 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/54cf8b1aeabb456daeea1e2652ab211f}] 2023-03-14 10:54:19,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/54cf8b1aeabb456daeea1e2652ab211f for inclusion in 4330ab5c277432d16109867ee596c48d/family1 2023-03-14 10:54:19,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-14 10:54:19,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 10:54:19,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/54cf8b1aeabb456daeea1e2652ab211f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testScannerOnBulkLoadRefHFiles__fv2mamd8ikmlhmd607ob5kle042rn68dcih57sj58o9g9u3onl7i1904h9ja16qs/family1/54cf8b1aeabb456daeea1e2652ab211f 2023-03-14 10:54:19,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testScannerOnBulkLoadRefHFiles__fv2mamd8ikmlhmd607ob5kle042rn68dcih57sj58o9g9u3onl7i1904h9ja16qs/family1/54cf8b1aeabb456daeea1e2652ab211f as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_ 2023-03-14 10:54:19,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testScannerOnBulkLoadRefHFiles__fv2mamd8ikmlhmd607ob5kle042rn68dcih57sj58o9g9u3onl7i1904h9ja16qs/family1/54cf8b1aeabb456daeea1e2652ab211f into 4330ab5c277432d16109867ee596c48d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_ - updating store file list. 2023-03-14 10:54:19,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_ into 4330ab5c277432d16109867ee596c48d/family1 2023-03-14 10:54:19,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testScannerOnBulkLoadRefHFiles__fv2mamd8ikmlhmd607ob5kle042rn68dcih57sj58o9g9u3onl7i1904h9ja16qs/family1/54cf8b1aeabb456daeea1e2652ab211f into 4330ab5c277432d16109867ee596c48d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_) 2023-03-14 10:54:19,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testScannerOnBulkLoadRefHFiles__fv2mamd8ikmlhmd607ob5kle042rn68dcih57sj58o9g9u3onl7i1904h9ja16qs/family1/54cf8b1aeabb456daeea1e2652ab211f 2023-03-14 10:54:19,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:54:19,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:54:19,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 4330ab5c277432d16109867ee596c48d/family1 is initiating minor compaction (all files) 2023-03-14 10:54:19,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@73484528; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:19,523 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4330ab5c277432d16109867ee596c48d/family1 in testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:54:19,523 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp, totalSize=15.1 K 2023-03-14 10:54:19,524 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 151dcf5422434f668cc54d37f73d8636, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791256688 2023-03-14 10:54:19,525 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 21f6a252167b4260b0b1d81056de6ea8, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791256688 2023-03-14 10:54:19,525 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 276fe5076ecc427fba8200677e7903ef_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791256688 2023-03-14 10:54:19,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 10:54:19,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:19,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031411e538def6c94cdeb1e16f4803877567 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031411e538def6c94cdeb1e16f4803877567 2023-03-14 10:54:19,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314322667f85b5c439eb77294a49872d559 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314322667f85b5c439eb77294a49872d559 2023-03-14 10:54:19,529 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-14 10:54:19,529 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 10:54:19,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-14 10:54:19,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 10:54:19,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:19,532 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 10:54:19,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 902 msec 2023-03-14 10:54:19,537 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4330ab5c277432d16109867ee596c48d#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:19,563 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 248) - Thread LEAK? -, OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 288), ProcessCount=169 (was 169), AvailableMemoryMB=2766 (was 2932) 2023-03-14 10:54:19,576 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=169, AvailableMemoryMB=2766 2023-03-14 10:54:19,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:54:19,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:19,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:54:19,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-14 10:54:19,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:54:19,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:19,583 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:19,583 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5 empty. 2023-03-14 10:54:19,584 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:19,584 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-14 10:54:19,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:19,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:19,992 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:19,993 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c42127be2a634116538df3e30bdeac5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:20,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:20,358 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/.tmp/family1/26efeb67612f4c12b6d92188706a9c35 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/26efeb67612f4c12b6d92188706a9c35 2023-03-14 10:54:20,363 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4330ab5c277432d16109867ee596c48d/family1 of 4330ab5c277432d16109867ee596c48d into 26efeb67612f4c12b6d92188706a9c35(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:20,363 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:54:20,363 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678791259523; duration=0sec 2023-03-14 10:54:20,363 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:20,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:20,399 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 0c42127be2a634116538df3e30bdeac5, disabling compactions & flushes 2023-03-14 10:54:20,399 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. after waiting 0 ms 2023-03-14 10:54:20,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,400 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:20,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:54:20,403 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791260403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791260403"}]},"ts":"1678791260403"} 2023-03-14 10:54:20,405 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:54:20,406 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:54:20,406 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791260406"}]},"ts":"1678791260406"} 2023-03-14 10:54:20,407 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-14 10:54:20,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=0c42127be2a634116538df3e30bdeac5, ASSIGN}] 2023-03-14 10:54:20,411 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=0c42127be2a634116538df3e30bdeac5, ASSIGN 2023-03-14 10:54:20,411 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=0c42127be2a634116538df3e30bdeac5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:20,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_] to archive 2023-03-14 10:54:20,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:20,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/151dcf5422434f668cc54d37f73d8636 2023-03-14 10:54:20,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/21f6a252167b4260b0b1d81056de6ea8 2023-03-14 10:54:20,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/family1/276fe5076ecc427fba8200677e7903ef_SeqId_12_ 2023-03-14 10:54:20,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0c42127be2a634116538df3e30bdeac5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:20,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791260562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791260562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791260562"}]},"ts":"1678791260562"} 2023-03-14 10:54:20,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 0c42127be2a634116538df3e30bdeac5, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:20,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:20,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c42127be2a634116538df3e30bdeac5, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:20,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:20,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,721 INFO [StoreOpener-0c42127be2a634116538df3e30bdeac5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,722 DEBUG [StoreOpener-0c42127be2a634116538df3e30bdeac5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:20,722 DEBUG [StoreOpener-0c42127be2a634116538df3e30bdeac5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:20,723 INFO [StoreOpener-0c42127be2a634116538df3e30bdeac5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c42127be2a634116538df3e30bdeac5 columnFamilyName family1 2023-03-14 10:54:20,724 INFO [StoreOpener-0c42127be2a634116538df3e30bdeac5-1] regionserver.HStore(310): Store=0c42127be2a634116538df3e30bdeac5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:54:20,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:20,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c42127be2a634116538df3e30bdeac5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72693770, jitterRate=0.08322158455848694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:20,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:20,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5., pid=37, masterSystemTime=1678791260716 2023-03-14 10:54:20,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:20,734 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0c42127be2a634116538df3e30bdeac5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:20,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678791260734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791260734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791260734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791260734"}]},"ts":"1678791260734"} 2023-03-14 10:54:20,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-14 10:54:20,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 0c42127be2a634116538df3e30bdeac5, server=jenkins-hbase4.apache.org,36455,1678791214611 in 172 msec 2023-03-14 10:54:20,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-14 10:54:20,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=0c42127be2a634116538df3e30bdeac5, ASSIGN in 329 msec 2023-03-14 10:54:20,741 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:54:20,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791260741"}]},"ts":"1678791260741"} 2023-03-14 10:54:20,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-14 10:54:20,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:54:20,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1670 sec 2023-03-14 10:54:21,274 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:54:21,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 10:54:21,688 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-14 10:54:21,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:21,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,718 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:21,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:21,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:21,719 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:21,719 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,719 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:21,721 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:21,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:21,721 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:21,721 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,722 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:21,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:21,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:21,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:21,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:21,722 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:21,722 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:21,722 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:21,723 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:54:22,146 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307668b1beaf39439ab2cd885f0c37d9c8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307668b1beaf39439ab2cd885f0c37d9c8 2023-03-14 10:54:22,550 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d596984e8cd34d369bbab01534316f59 2023-03-14 10:54:22,555 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d596984e8cd34d369bbab01534316f59 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59 2023-03-14 10:54:22,559 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-14 10:54:22,560 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 837ms, sequenceid=5, compaction requested=false 2023-03-14 10:54:22,560 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:22,561 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:22,561 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:22,563 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:22,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:22,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44ec7bd1[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:22,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:22,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,565 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:22,566 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,566 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:22,568 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,568 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:22,568 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:22,568 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:22,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:22,570 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:22,570 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:22,570 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:22,570 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,570 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:22,572 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:22,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:22,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:22,572 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,573 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:22,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:22,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:22,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:22,575 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,575 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:22,576 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:22,576 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:22,576 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:22,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:22,676 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:22,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:22,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,683 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:22,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:22,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:22,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:22,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,684 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,685 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,685 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:22,685 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:22,685 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,686 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:22,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:22,686 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:22,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:22,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:22,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:22,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:22,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:22,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:22,687 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:54:23,100 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280b0a7085c7ef4ffabc114188eef99d4e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511280b0a7085c7ef4ffabc114188eef99d4e 2023-03-14 10:54:23,505 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/4ade8511600e4f2caa74125c9a42233c 2023-03-14 10:54:23,510 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/4ade8511600e4f2caa74125c9a42233c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c 2023-03-14 10:54:23,514 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:54:23,515 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 828ms, sequenceid=9, compaction requested=false 2023-03-14 10:54:23,515 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:23,515 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:23,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:23,518 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,518 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:23,518 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,518 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:23,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76b2010a[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:23,519 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:23,519 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,523 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:23,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:23,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:23,523 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,523 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:23,525 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:23,525 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:23,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:23,531 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:23,532 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:23,532 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:23,532 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,532 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:23,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:23,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,535 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:23,535 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,536 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,539 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,539 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:23,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:23,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:23,538 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:23,539 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,539 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:23,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:23,539 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:23,539 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:23,639 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:23,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:23,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:23,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:23,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,646 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:23,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:23,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:23,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:23,647 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,647 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,648 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,648 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:23,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:23,648 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:23,648 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:23,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:23,650 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:23,650 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:23,650 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:24,067 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014c35b1662e974843b007a94f59e35869 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014c35b1662e974843b007a94f59e35869 2023-03-14 10:54:24,473 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b 2023-03-14 10:54:24,478 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b 2023-03-14 10:54:24,483 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 10:54:24,484 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 834ms, sequenceid=13, compaction requested=true 2023-03-14 10:54:24,484 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:24,484 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:24,484 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:24,484 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:24,485 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,485 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:24,485 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:24,486 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,486 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:24,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:24,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:24,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2206bdf0[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:24,488 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:24,488 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,492 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:24,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:24,492 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,492 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:24,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:24,493 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:24,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:24,495 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:24,495 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:24,496 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:24,496 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,496 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:24,497 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,497 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,497 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:24,497 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:24,498 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:24,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:24,501 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:24,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:24,501 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:24,602 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:24,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:24,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:24,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:24,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,608 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:24,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:24,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:24,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:24,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,609 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,611 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:24,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:24,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:24,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:24,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,612 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:24,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:24,612 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:24,612 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:24,613 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:24,613 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:24,613 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:24,613 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:25,026 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059cf7d5ddfaab474ebe7c28cd44f702d8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512059cf7d5ddfaab474ebe7c28cd44f702d8 2023-03-14 10:54:25,432 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/69f05c98df614fcc84433706df128bc6 2023-03-14 10:54:25,437 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/69f05c98df614fcc84433706df128bc6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6 2023-03-14 10:54:25,441 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 10:54:25,442 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 829ms, sequenceid=17, compaction requested=true 2023-03-14 10:54:25,442 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:25,442 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:25,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:25,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:25,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:25,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:25,444 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,444 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:25,444 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,444 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f662b4f[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:25,445 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:25,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,447 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,447 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:25,447 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:25,447 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:25,447 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,447 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:25,448 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,448 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:25,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:25,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:25,448 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:25,448 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:25,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:25,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:25,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:25,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:25,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:25,450 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:25,451 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:25,451 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:25,451 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,451 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:25,453 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,453 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:25,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,453 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:25,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:25,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:25,454 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,455 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:25,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:25,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:25,457 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:25,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:25,457 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:25,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:25,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:25,557 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:25,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:25,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,563 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:25,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:25,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:25,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:25,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,565 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:25,565 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:25,566 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:25,566 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:25,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:25,567 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:25,567 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:25,567 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:25,982 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122852349acf86674934b625ff38c3d56889 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122852349acf86674934b625ff38c3d56889 2023-03-14 10:54:26,221 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:54:26,388 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/fd34f62af5eb4d7ca5eaed28c9d71855 2023-03-14 10:54:26,393 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/fd34f62af5eb4d7ca5eaed28c9d71855 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855 2023-03-14 10:54:26,397 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 10:54:26,398 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 831ms, sequenceid=21, compaction requested=true 2023-03-14 10:54:26,398 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:26,398 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:26,403 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,403 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:26,404 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:26,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:26,405 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:26,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4873e781[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:26,405 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,406 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,406 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:26,406 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:26,406 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:26,406 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,406 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:26,408 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,408 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:26,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:26,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:26,410 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:26,410 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:26,410 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:26,410 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,410 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:26,411 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,411 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:26,412 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:26,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:26,412 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,413 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:26,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,421 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:26,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:26,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:26,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,421 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,422 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:26,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:26,422 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:26,422 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:26,522 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:26,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:26,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:26,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:26,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,528 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:26,528 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:26,528 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:26,528 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:26,529 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,529 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,530 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:26,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:26,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:26,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:26,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,531 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:26,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:26,532 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:26,532 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:26,532 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:26,532 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:26,532 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:26,532 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:26,532 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:26,532 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:26,945 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316038e163fb65496ca2de6779572879b9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316038e163fb65496ca2de6779572879b9 2023-03-14 10:54:27,351 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/c08930b3364e4f23bfb4eabcf7c983f7 2023-03-14 10:54:27,356 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/c08930b3364e4f23bfb4eabcf7c983f7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7 2023-03-14 10:54:27,360 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 10:54:27,361 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 829ms, sequenceid=25, compaction requested=true 2023-03-14 10:54:27,361 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:27,361 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:27,363 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,363 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:27,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:27,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2eaf05d4[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:27,365 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:27,365 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,366 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,366 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:27,366 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,366 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:27,366 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:27,366 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:27,369 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,369 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:27,369 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:27,369 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:27,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:27,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:27,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:27,371 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:27,371 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:27,371 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:27,371 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,371 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:27,372 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,372 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,372 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:27,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:27,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:27,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:27,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:27,373 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:27,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,374 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:27,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,376 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,376 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:27,376 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:27,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:27,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:27,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:27,376 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:27,376 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,376 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,377 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:27,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:27,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:27,477 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:27,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:27,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:27,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:27,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,483 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:27,484 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:27,484 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:27,484 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:27,484 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,484 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,485 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,485 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:27,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:27,486 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:27,486 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:27,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:27,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:27,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:27,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:27,488 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:27,488 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:27,488 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:27,488 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:27,900 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010124ffab32b2564d449b333cf1e015d96c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010124ffab32b2564d449b333cf1e015d96c 2023-03-14 10:54:28,306 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/2abf3fb85fb74febbf76a954b4979fd3 2023-03-14 10:54:28,310 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/2abf3fb85fb74febbf76a954b4979fd3 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3 2023-03-14 10:54:28,314 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 10:54:28,315 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 827ms, sequenceid=29, compaction requested=true 2023-03-14 10:54:28,315 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:28,315 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:28,315 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:28,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:28,318 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:28,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:28,319 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,319 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:28,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:28,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39d1d4cc[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:28,320 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:28,320 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,321 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:28,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:28,322 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,322 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:28,322 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:28,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:28,325 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:28,325 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:28,325 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:28,325 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,325 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:28,326 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,326 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:28,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,326 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:28,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:28,327 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,328 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:28,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:28,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:28,331 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:28,332 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:28,332 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:28,332 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:28,332 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:28,432 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:28,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:28,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:28,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:28,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,439 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,439 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,448 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:28,448 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:28,449 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:28,449 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:28,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:28,450 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:28,450 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:28,450 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:28,450 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:28,450 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:28,450 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:28,450 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:28,450 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:28,864 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103838487ea6cfb44f28671f4ac170644bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103838487ea6cfb44f28671f4ac170644bd 2023-03-14 10:54:29,270 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/eae6fc7a86c34afaa8977d8dceda6830 2023-03-14 10:54:29,275 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/eae6fc7a86c34afaa8977d8dceda6830 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830 2023-03-14 10:54:29,279 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 10:54:29,280 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 830ms, sequenceid=33, compaction requested=true 2023-03-14 10:54:29,280 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:29,280 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:29,280 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:29,280 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:29,280 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,280 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:29,280 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:29,282 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:29,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:29,284 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:29,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67b3acea[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:29,284 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,286 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,286 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:29,286 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:29,286 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:29,286 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,286 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:29,287 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:29,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:29,289 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:29,289 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:29,289 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:29,289 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,289 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:29,291 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,291 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,291 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:29,291 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,292 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,294 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:29,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:29,295 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:29,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:29,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,295 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:29,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:29,396 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:29,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:29,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:29,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:29,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,402 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:29,402 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:29,402 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:29,402 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:29,403 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,403 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,405 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,405 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:29,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:29,405 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,405 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:29,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:29,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,406 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,406 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:29,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:29,407 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:29,407 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:29,407 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:29,820 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a504803a45924b18bfd1d49959680506 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907a504803a45924b18bfd1d49959680506 2023-03-14 10:54:29,825 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d031e554fe504c7384ab82e6ccd5f535 2023-03-14 10:54:29,829 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d031e554fe504c7384ab82e6ccd5f535 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535 2023-03-14 10:54:29,833 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 10:54:29,834 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 427ms, sequenceid=37, compaction requested=true 2023-03-14 10:54:29,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:29,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:29,836 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:29,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@302b1072[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:29,837 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:29,837 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,838 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:29,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:29,839 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:29,840 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:29,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:29,842 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:29,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:29,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:29,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,842 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:29,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:29,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:29,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:29,845 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,846 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:29,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:29,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:29,848 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,848 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,849 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,849 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:29,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:29,849 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:29,849 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,949 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:29,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:29,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:29,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:29,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,956 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:29,956 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:29,956 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 10:54:29,956 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 10:54:29,956 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,956 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,957 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:29,957 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:29,958 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:29,958 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:29,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,959 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,959 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 10:54:29,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:29,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 10:54:29,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:29,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 10:54:29,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:29,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:29,959 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:29,959 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. started... 2023-03-14 10:54:29,960 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c42127be2a634116538df3e30bdeac5 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:30,372 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120478eb2d66d214971a4b25b6813f339d1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120478eb2d66d214971a4b25b6813f339d1 2023-03-14 10:54:30,778 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d49c170ab0c54052994c5dd4ceddc805 2023-03-14 10:54:30,783 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/d49c170ab0c54052994c5dd4ceddc805 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805 2023-03-14 10:54:30,787 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 10:54:30,788 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c42127be2a634116538df3e30bdeac5 in 828ms, sequenceid=41, compaction requested=true 2023-03-14 10:54:30,788 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:30,788 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:30,788 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:30,788 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:30,788 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,788 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 10:54:30,788 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 10:54:30,790 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:30,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:30,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:30,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:30,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:30,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 10:54:30,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66fc3206[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:30,792 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 10:54:30,792 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,793 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 10:54:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 10:54:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:30,794 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,794 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:30,795 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 10:54:30,795 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,795 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:30,795 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 10:54:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:30,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:54:30,797 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 10:54:30,797 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:30,797 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:30,797 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,797 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:30,798 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,798 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,798 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:30,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:30,799 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:30,800 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:30,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:30,806 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:30,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:30,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 10:54:30,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 10:54:30,806 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:30,807 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:30,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:30,807 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,807 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:30,807 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:30,807 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,907 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:30,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:30,909 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-14 10:54:30,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:30,911 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:30,912 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791870912 2023-03-14 10:54:30,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:30,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:30,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-14 10:54:30,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:30,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x1a514096 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:30,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3accf733, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:30,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,759 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010322e42c65d02348a493dd5b868159ba77 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010322e42c65d02348a493dd5b868159ba77 2023-03-14 10:54:31,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:31,773 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:31,774 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:31,781 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:31,781 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:31,790 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 first=Optional[r3] last=Optional[r6] 2023-03-14 10:54:31,791 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/60d6cbb4c8ea43c1be8801dfa7d68b04}] 2023-03-14 10:54:31,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 for inclusion in 0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 10:54:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:31,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:31,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d4gg8n0vf9r5r2hpuk3gjdg5nq9hue8rioed07annvg5f43m7j2bui4tghq1rdk3/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 2023-03-14 10:54:31,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d4gg8n0vf9r5r2hpuk3gjdg5nq9hue8rioed07annvg5f43m7j2bui4tghq1rdk3/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_ 2023-03-14 10:54:31,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d4gg8n0vf9r5r2hpuk3gjdg5nq9hue8rioed07annvg5f43m7j2bui4tghq1rdk3/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 into 0c42127be2a634116538df3e30bdeac5/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_ - updating store file list. 2023-03-14 10:54:31,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_ into 0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:31,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d4gg8n0vf9r5r2hpuk3gjdg5nq9hue8rioed07annvg5f43m7j2bui4tghq1rdk3/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 into 0c42127be2a634116538df3e30bdeac5/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_) 2023-03-14 10:54:31,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d4gg8n0vf9r5r2hpuk3gjdg5nq9hue8rioed07annvg5f43m7j2bui4tghq1rdk3/family1/60d6cbb4c8ea43c1be8801dfa7d68b04 2023-03-14 10:54:31,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:54:31,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:54:31,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 0c42127be2a634116538df3e30bdeac5/family1 is initiating minor compaction 2023-03-14 10:54:31,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7515c011; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:31,808 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0c42127be2a634116538df3e30bdeac5/family1 in testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:31,808 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp, totalSize=50.0 K 2023-03-14 10:54:31,808 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 4ade8511600e4f2caa74125c9a42233c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:54:31,808 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 8c739ede9a0a49edb54ebeb0ed6e6d5b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:54:31,808 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 69f05c98df614fcc84433706df128bc6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:54:31,808 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting fd34f62af5eb4d7ca5eaed28c9d71855, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting c08930b3364e4f23bfb4eabcf7c983f7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 2abf3fb85fb74febbf76a954b4979fd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting eae6fc7a86c34afaa8977d8dceda6830, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d031e554fe504c7384ab82e6ccd5f535, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d49c170ab0c54052994c5dd4ceddc805, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:54:31,809 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting e313b48ff5c54450b5bc9f95840102f1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:54:31,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:31,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:31,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122852349acf86674934b625ff38c3d56889 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122852349acf86674934b625ff38c3d56889 2023-03-14 10:54:31,816 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316038e163fb65496ca2de6779572879b9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316038e163fb65496ca2de6779572879b9 2023-03-14 10:54:31,818 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010124ffab32b2564d449b333cf1e015d96c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010124ffab32b2564d449b333cf1e015d96c 2023-03-14 10:54:31,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103838487ea6cfb44f28671f4ac170644bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103838487ea6cfb44f28671f4ac170644bd 2023-03-14 10:54:31,820 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-14 10:54:31,820 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 10:54:31,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:31,851 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0c42127be2a634116538df3e30bdeac5#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:32,668 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/7492a6df9fe448a7b4f6bd2391db9866 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866 2023-03-14 10:54:32,673 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0c42127be2a634116538df3e30bdeac5/family1 of 0c42127be2a634116538df3e30bdeac5 into 7492a6df9fe448a7b4f6bd2391db9866(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:32,673 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:32,674 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678791271808; duration=0sec 2023-03-14 10:54:32,674 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:32,682 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205555515e22c974174a252cd0d876ca9e0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205555515e22c974174a252cd0d876ca9e0 2023-03-14 10:54:32,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:32,710 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/730d04998ae041a99b3ebc5e4b4ef779 first=Optional[r00] last=Optional[r2] 2023-03-14 10:54:32,711 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/730d04998ae041a99b3ebc5e4b4ef779}] 2023-03-14 10:54:32,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/730d04998ae041a99b3ebc5e4b4ef779 for inclusion in 0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:32,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 10:54:32,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:32,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:32,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/730d04998ae041a99b3ebc5e4b4ef779 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d46n7bukipj9lvetvii3ufcpj2p1mh318ehpb9675ls7ak06kljgbvvbsgdo2cfp/family1/730d04998ae041a99b3ebc5e4b4ef779 2023-03-14 10:54:32,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d46n7bukipj9lvetvii3ufcpj2p1mh318ehpb9675ls7ak06kljgbvvbsgdo2cfp/family1/730d04998ae041a99b3ebc5e4b4ef779 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_ 2023-03-14 10:54:32,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d46n7bukipj9lvetvii3ufcpj2p1mh318ehpb9675ls7ak06kljgbvvbsgdo2cfp/family1/730d04998ae041a99b3ebc5e4b4ef779 into 0c42127be2a634116538df3e30bdeac5/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_ - updating store file list. 2023-03-14 10:54:32,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_ into 0c42127be2a634116538df3e30bdeac5/family1 2023-03-14 10:54:32,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d46n7bukipj9lvetvii3ufcpj2p1mh318ehpb9675ls7ak06kljgbvvbsgdo2cfp/family1/730d04998ae041a99b3ebc5e4b4ef779 into 0c42127be2a634116538df3e30bdeac5/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_) 2023-03-14 10:54:32,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d46n7bukipj9lvetvii3ufcpj2p1mh318ehpb9675ls7ak06kljgbvvbsgdo2cfp/family1/730d04998ae041a99b3ebc5e4b4ef779 2023-03-14 10:54:32,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:54:32,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:54:32,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 0c42127be2a634116538df3e30bdeac5/family1 is initiating minor compaction (all files) 2023-03-14 10:54:32,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@20881031; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:32,726 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0c42127be2a634116538df3e30bdeac5/family1 in testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:54:32,726 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp, totalSize=337.0 K 2023-03-14 10:54:32,727 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d596984e8cd34d369bbab01534316f59, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:54:32,727 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 7492a6df9fe448a7b4f6bd2391db9866, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:54:32,728 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting a3b8a03d291a4258a68140b39dacbe39_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837821 2023-03-14 10:54:32,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:32,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:32,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307668b1beaf39439ab2cd885f0c37d9c8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307668b1beaf39439ab2cd885f0c37d9c8 2023-03-14 10:54:32,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014c35b1662e974843b007a94f59e35869 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512014c35b1662e974843b007a94f59e35869 2023-03-14 10:54:32,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512059cf7d5ddfaab474ebe7c28cd44f702d8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512059cf7d5ddfaab474ebe7c28cd44f702d8 2023-03-14 10:54:32,741 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-14 10:54:32,741 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 10:54:32,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 10:54:32,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 10:54:32,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:32,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_] to archive 2023-03-14 10:54:32,746 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:54:32,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:32,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8360 sec 2023-03-14 10:54:32,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/4ade8511600e4f2caa74125c9a42233c 2023-03-14 10:54:32,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/8c739ede9a0a49edb54ebeb0ed6e6d5b 2023-03-14 10:54:32,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/69f05c98df614fcc84433706df128bc6 2023-03-14 10:54:32,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/fd34f62af5eb4d7ca5eaed28c9d71855 2023-03-14 10:54:32,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/c08930b3364e4f23bfb4eabcf7c983f7 2023-03-14 10:54:32,762 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0c42127be2a634116538df3e30bdeac5#family1#compaction#50 average throughput is 11.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:32,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/2abf3fb85fb74febbf76a954b4979fd3 2023-03-14 10:54:32,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/eae6fc7a86c34afaa8977d8dceda6830 2023-03-14 10:54:32,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d031e554fe504c7384ab82e6ccd5f535 2023-03-14 10:54:32,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d49c170ab0c54052994c5dd4ceddc805 2023-03-14 10:54:32,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/e313b48ff5c54450b5bc9f95840102f1_SeqId_44_ 2023-03-14 10:54:32,824 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/.tmp/family1/b4febacdb2834daeac351935cb192e9a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/b4febacdb2834daeac351935cb192e9a 2023-03-14 10:54:32,830 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0c42127be2a634116538df3e30bdeac5/family1 of 0c42127be2a634116538df3e30bdeac5 into b4febacdb2834daeac351935cb192e9a(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:32,830 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:54:32,830 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1678791272726; duration=0sec 2023-03-14 10:54:32,830 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:32,833 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2696): Can't archive compacted file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866 because of either isCompactedAway=true or file has reference, isReferencedInReads=true, refCount=1, skipping for now. 2023-03-14 10:54:32,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_] to archive 2023-03-14 10:54:32,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:32,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/d596984e8cd34d369bbab01534316f59 2023-03-14 10:54:32,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/a3b8a03d291a4258a68140b39dacbe39_SeqId_47_ 2023-03-14 10:54:32,864 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255 (was 249) - Thread LEAK? -, OpenFileDescriptor=622 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 273), ProcessCount=169 (was 169), AvailableMemoryMB=2854 (was 2766) - AvailableMemoryMB LEAK? - 2023-03-14 10:54:32,876 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=255, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=169, AvailableMemoryMB=2854 2023-03-14 10:54:32,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:54:32,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:32,880 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:54:32,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-14 10:54:32,880 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:54:32,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:32,882 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:32,882 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d empty. 2023-03-14 10:54:32,883 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:32,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-14 10:54:32,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866] to archive 2023-03-14 10:54:32,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:32,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/family1/7492a6df9fe448a7b4f6bd2391db9866 2023-03-14 10:54:32,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:33,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:33,294 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:33,295 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52038bd8d7c0b7c72eff2e24f9c5a70d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:33,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:33,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:33,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 52038bd8d7c0b7c72eff2e24f9c5a70d, disabling compactions & flushes 2023-03-14 10:54:33,702 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:33,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:33,703 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. after waiting 0 ms 2023-03-14 10:54:33,703 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:33,703 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:33,703 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:33,705 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:54:33,706 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791273706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791273706"}]},"ts":"1678791273706"} 2023-03-14 10:54:33,707 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:54:33,708 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:54:33,708 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791273708"}]},"ts":"1678791273708"} 2023-03-14 10:54:33,709 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-14 10:54:33,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, ASSIGN}] 2023-03-14 10:54:33,714 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, ASSIGN 2023-03-14 10:54:33,715 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:33,866 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:33,866 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791273866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791273866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791273866"}]},"ts":"1678791273866"} 2023-03-14 10:54:33,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:34,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:34,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52038bd8d7c0b7c72eff2e24f9c5a70d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:34,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:34,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,024 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,026 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:34,026 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:34,026 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52038bd8d7c0b7c72eff2e24f9c5a70d columnFamilyName family1 2023-03-14 10:54:34,027 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(310): Store=52038bd8d7c0b7c72eff2e24f9c5a70d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:34,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:34,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:34,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52038bd8d7c0b7c72eff2e24f9c5a70d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61412645, jitterRate=-0.0848802775144577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:34,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:34,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., pid=41, masterSystemTime=1678791274019 2023-03-14 10:54:34,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:34,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:34,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:34,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791274038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791274038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791274038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791274038"}]},"ts":"1678791274038"} 2023-03-14 10:54:34,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-14 10:54:34,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 171 msec 2023-03-14 10:54:34,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-14 10:54:34,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, ASSIGN in 329 msec 2023-03-14 10:54:34,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:54:34,043 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791274043"}]},"ts":"1678791274043"} 2023-03-14 10:54:34,044 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-14 10:54:34,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:54:34,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1700 sec 2023-03-14 10:54:34,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 10:54:34,987 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-14 10:54:35,017 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:35,018 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a514096 to 127.0.0.1:58692 2023-03-14 10:54:35,018 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:35,018 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:35,018 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x063760d7 to 127.0.0.1:58692 2023-03-14 10:54:35,018 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:35,018 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:54:35,018 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41f27063 to 127.0.0.1:58692 2023-03-14 10:54:35,018 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:54:35,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:35,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,034 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:35,034 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:35,034 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:35,034 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:35,034 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,034 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:35,036 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,036 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,036 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:35,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:35,037 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:35,037 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:35,037 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:35,038 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:54:35,463 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130da11a9c29d2a4448a86f04d07a9d1559 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130da11a9c29d2a4448a86f04d07a9d1559 2023-03-14 10:54:35,867 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/0af78b7ab02e4e4997854374b307bc27 2023-03-14 10:54:35,873 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/0af78b7ab02e4e4997854374b307bc27 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27 2023-03-14 10:54:35,877 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-14 10:54:35,878 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 840ms, sequenceid=5, compaction requested=false 2023-03-14 10:54:35,878 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:35,879 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:35,879 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:35,879 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:35,879 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:35,879 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,879 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:35,879 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:35,880 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,880 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:35,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,881 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:35,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:35,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51bcfda1[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:35,882 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:35,882 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,883 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:35,883 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,884 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:35,885 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:35,885 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:35,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:35,887 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:35,888 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:35,888 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:35,888 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,888 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:35,889 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,889 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:35,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,889 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:35,889 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,891 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:35,893 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:35,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:35,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:35,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:35,893 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:35,894 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:35,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:35,922 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 10:54:35,994 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:35,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:35,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:36,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:36,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,000 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:36,000 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:36,000 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:36,000 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:36,001 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,001 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,002 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,002 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:36,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:36,002 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,002 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:36,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:36,003 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:36,004 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:36,004 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:36,004 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:54:36,417 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112840c8b3cf0d9e4fd29bbb0890c9dfca43 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112840c8b3cf0d9e4fd29bbb0890c9dfca43 2023-03-14 10:54:36,823 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/9b058fd6bfc146028dfc0a630d9f272d 2023-03-14 10:54:36,828 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/9b058fd6bfc146028dfc0a630d9f272d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d 2023-03-14 10:54:36,832 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:54:36,832 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 828ms, sequenceid=9, compaction requested=false 2023-03-14 10:54:36,833 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:36,833 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:36,833 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:36,833 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:36,833 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,833 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:36,833 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:36,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,835 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:36,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,835 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b12df80[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:36,837 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:36,837 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,838 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:36,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:36,838 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:36,838 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,838 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:36,839 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:36,839 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,839 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:36,839 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:36,842 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:36,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:36,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:36,842 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,842 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:36,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:36,844 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:36,845 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,846 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:36,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:36,851 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:36,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:36,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:36,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:36,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:36,851 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,852 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,852 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,852 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:36,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:36,852 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:36,852 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:36,952 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:36,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:36,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:36,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:36,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,958 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:36,959 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:36,959 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:36,959 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:36,959 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,959 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,960 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:36,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:36,960 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,961 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:36,961 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:36,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,961 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:36,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:36,962 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:36,962 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:36,962 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:36,962 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:36,962 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:36,962 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:36,962 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:36,962 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:37,376 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201239d9d3ae5b244509a6b611c407bc1a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201239d9d3ae5b244509a6b611c407bc1a4 2023-03-14 10:54:37,782 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/de9b3c682f4b47fca45906f404fb4543 2023-03-14 10:54:37,787 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/de9b3c682f4b47fca45906f404fb4543 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543 2023-03-14 10:54:37,791 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 10:54:37,791 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 829ms, sequenceid=13, compaction requested=true 2023-03-14 10:54:37,792 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:37,792 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:37,794 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,794 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:37,795 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,795 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43d2f210[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:37,796 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:37,796 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,797 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:37,798 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,798 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:37,799 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:37,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:37,801 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:37,801 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:37,801 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:37,801 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,801 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:37,803 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,803 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:37,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,803 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:37,803 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,804 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,808 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:37,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:37,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:37,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:37,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:37,808 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:37,809 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:37,909 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:37,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:37,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:37,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,915 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:37,915 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:37,915 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:37,915 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:37,916 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,916 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,917 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:37,917 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:37,917 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:37,917 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,918 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:37,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:37,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:37,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:37,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:37,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:37,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:37,919 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:37,919 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:37,919 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:38,332 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a250d0be3ee04ee28b385120b7900d15 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a250d0be3ee04ee28b385120b7900d15 2023-03-14 10:54:38,738 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/6d7e686f236349f3827377f1fd654280 2023-03-14 10:54:38,743 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/6d7e686f236349f3827377f1fd654280 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280 2023-03-14 10:54:38,747 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 10:54:38,748 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 829ms, sequenceid=17, compaction requested=true 2023-03-14 10:54:38,748 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:38,748 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:38,750 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:38,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:38,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4439946e[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:38,752 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:38,752 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,753 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:38,753 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,753 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:38,755 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,755 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:38,755 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:38,755 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:38,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:38,757 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:38,757 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:38,757 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:38,757 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,757 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:38,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:38,759 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:38,759 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,761 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,763 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:38,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:38,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:38,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:38,763 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:38,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:38,864 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:38,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:38,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:38,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:38,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,871 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:38,871 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:38,871 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:38,871 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:38,872 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,872 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,873 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:38,873 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:38,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:38,873 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:38,873 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,874 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:38,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:38,874 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:38,875 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:38,875 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:38,875 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:38,875 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:39,288 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c87893dcddde41b4bd2eb4afc857ace7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c87893dcddde41b4bd2eb4afc857ace7 2023-03-14 10:54:39,569 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:54:39,694 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/f778fdd6641a45c28ad028116da06a70 2023-03-14 10:54:39,699 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/f778fdd6641a45c28ad028116da06a70 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70 2023-03-14 10:54:39,703 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 10:54:39,704 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 829ms, sequenceid=21, compaction requested=true 2023-03-14 10:54:39,704 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:39,704 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:39,710 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:39,711 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,711 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:39,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:39,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72de28bd[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:39,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:39,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,713 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,713 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:39,713 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:39,713 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:39,716 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:39,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:39,718 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:39,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:39,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:39,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,718 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:39,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:39,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:39,720 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,721 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,723 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,723 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,723 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:39,723 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:39,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:39,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:39,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:39,724 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:39,724 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:39,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:39,824 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:39,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:39,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:39,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,831 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:39,831 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:39,831 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:39,831 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:39,831 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,831 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,832 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:39,832 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:39,833 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,833 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:39,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:39,834 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:39,834 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:40,248 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fadeb5eb07e44a57839d44c36d0a6c85 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadeb5eb07e44a57839d44c36d0a6c85 2023-03-14 10:54:40,653 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/7ae3a067dc9c47219353aed5a993808e 2023-03-14 10:54:40,659 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/7ae3a067dc9c47219353aed5a993808e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e 2023-03-14 10:54:40,663 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 10:54:40,664 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 830ms, sequenceid=25, compaction requested=true 2023-03-14 10:54:40,664 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:40,664 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:40,664 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:40,664 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:40,664 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,664 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:40,664 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:40,665 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,665 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:40,666 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,666 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f8d17b9[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:40,667 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:40,667 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,668 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:40,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,669 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:40,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:40,670 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:40,670 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:40,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:40,673 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:40,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:40,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:40,673 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,673 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:40,675 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,675 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:40,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,675 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:40,676 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,677 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:40,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:40,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:40,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:40,679 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,679 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:40,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,680 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,680 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:40,680 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:40,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:40,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:40,780 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:40,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:40,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:40,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:40,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,787 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:40,787 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:40,787 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:40,787 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:40,787 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,787 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,789 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:40,789 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:40,789 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:40,789 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,790 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,790 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:40,790 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:40,790 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:40,790 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:40,804 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011d70c61f39c94b32ba47f44167acb563 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601011d70c61f39c94b32ba47f44167acb563 2023-03-14 10:54:41,209 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/58c4a48a4773406695ca75d9f6b0e6e7 2023-03-14 10:54:41,215 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/58c4a48a4773406695ca75d9f6b0e6e7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7 2023-03-14 10:54:41,219 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 10:54:41,220 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 430ms, sequenceid=29, compaction requested=true 2023-03-14 10:54:41,220 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:41,220 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:41,221 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:41,222 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:41,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:41,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1b3e2a[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:41,224 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:41,224 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,226 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:41,226 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,226 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:41,228 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:41,228 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:41,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:41,230 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:41,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:41,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:41,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,230 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:41,234 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,234 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:41,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,234 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:41,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:41,235 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,236 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:41,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,239 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:41,239 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:41,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:41,340 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:41,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:41,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:41,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,346 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:41,346 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:41,346 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:41,346 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:41,346 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,346 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,348 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:41,348 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,348 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:41,348 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:41,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,349 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:41,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:41,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:41,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:41,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:41,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:41,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:41,349 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:41,349 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:41,349 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:41,762 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010317b75de816314a57b8029bbe7ba17c07 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010317b75de816314a57b8029bbe7ba17c07 2023-03-14 10:54:42,168 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/566318bcf04943e1ad4f6834e1a201a2 2023-03-14 10:54:42,173 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/566318bcf04943e1ad4f6834e1a201a2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2 2023-03-14 10:54:42,177 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 10:54:42,178 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 829ms, sequenceid=33, compaction requested=true 2023-03-14 10:54:42,178 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:42,178 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:42,179 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:42,179 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,179 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:42,179 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:42,180 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:42,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,181 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:42,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:42,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@138943c3[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:42,182 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:42,182 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,183 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,183 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:42,183 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:42,183 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:42,183 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,183 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:42,186 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:42,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:42,188 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:42,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:42,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:42,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,188 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:42,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:42,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,190 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:42,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,191 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:42,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:42,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,193 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:42,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:42,194 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:42,194 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:42,193 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:42,194 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,194 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,294 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:42,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:42,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:42,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:42,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,301 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:42,301 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:42,301 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:42,301 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:42,301 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,301 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,302 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:42,302 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:42,302 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:42,303 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,303 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:42,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:42,303 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:42,304 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:42,304 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:42,304 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:42,717 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907641caacedeff4274918368b8c7faad6f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907641caacedeff4274918368b8c7faad6f 2023-03-14 10:54:43,123 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/c196446b86554f8382a6e66b076207a5 2023-03-14 10:54:43,128 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/c196446b86554f8382a6e66b076207a5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5 2023-03-14 10:54:43,131 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 10:54:43,132 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 828ms, sequenceid=37, compaction requested=true 2023-03-14 10:54:43,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:43,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:43,132 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:43,132 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:43,132 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,132 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:43,133 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:43,135 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:43,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:43,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,136 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:43,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:43,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10911acf[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:43,137 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:43,137 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,138 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:43,138 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,138 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:43,140 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:43,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:43,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:43,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:43,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:43,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:43,142 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:43,142 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:43,142 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:43,142 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,142 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:43,144 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,144 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:43,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,144 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:43,144 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,146 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:43,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:43,152 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:43,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:43,152 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,153 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,253 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:43,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:43,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:43,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:43,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,260 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:43,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:43,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 10:54:43,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 10:54:43,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,260 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,261 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:43,261 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:43,262 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:43,262 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,263 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 10:54:43,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 10:54:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 10:54:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:43,263 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:43,263 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. started... 2023-03-14 10:54:43,263 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 52038bd8d7c0b7c72eff2e24f9c5a70d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:43,676 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bf8db7544a0141b8bad017d2bf7fffd6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf8db7544a0141b8bad017d2bf7fffd6 2023-03-14 10:54:44,082 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/49c65c9880704c4f9cb5fadb17f9d967 2023-03-14 10:54:44,087 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/49c65c9880704c4f9cb5fadb17f9d967 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967 2023-03-14 10:54:44,091 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 10:54:44,092 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 52038bd8d7c0b7c72eff2e24f9c5a70d in 829ms, sequenceid=41, compaction requested=true 2023-03-14 10:54:44,092 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:44,092 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 10:54:44,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 10:54:44,094 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,094 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:44,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:44,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 10:54:44,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3706e7bb[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:44,095 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 10:54:44,096 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,097 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,097 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 10:54:44,097 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 10:54:44,097 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,097 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:44,097 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:44,102 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,102 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 10:54:44,102 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:44,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:44,102 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 10:54:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:44,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 10:54:44,105 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 10:54:44,105 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:44,105 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:44,105 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,105 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:44,106 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,106 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:44,106 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:44,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:44,107 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:44,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:44,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:44,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,108 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:44,110 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:44,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 10:54:44,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:44,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:44,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 10:54:44,111 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:44,111 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:44,110 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:44,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:44,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:44,111 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,111 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,111 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,211 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:44,213 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:44,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:44,215 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:44,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:44,216 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791884216 2023-03-14 10:54:44,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:44,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 10:54:44,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:44,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x2dfddebe to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:44,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7cd12d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:44,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,062 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033344adefa0e847c5bf5410e43715f17a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033344adefa0e847c5bf5410e43715f17a 2023-03-14 10:54:45,063 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:45,076 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:45,077 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:45,084 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:45,086 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:45,096 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd059ce226a349e7b6d424f2b7b387d3 first=Optional[r3] last=Optional[r6] 2023-03-14 10:54:45,097 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd059ce226a349e7b6d424f2b7b387d3}] 2023-03-14 10:54:45,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd059ce226a349e7b6d424f2b7b387d3 for inclusion in 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:45,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 10:54:45,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:45,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:45,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd059ce226a349e7b6d424f2b7b387d3 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ati1lj1lv3d1oacphih205oo1ls0lfopf5kc24ndda7418slgj2rdmm41tua9uhj/family1/bd059ce226a349e7b6d424f2b7b387d3 2023-03-14 10:54:45,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ati1lj1lv3d1oacphih205oo1ls0lfopf5kc24ndda7418slgj2rdmm41tua9uhj/family1/bd059ce226a349e7b6d424f2b7b387d3 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_ 2023-03-14 10:54:45,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ati1lj1lv3d1oacphih205oo1ls0lfopf5kc24ndda7418slgj2rdmm41tua9uhj/family1/bd059ce226a349e7b6d424f2b7b387d3 into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_ - updating store file list. 2023-03-14 10:54:45,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_ into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:45,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ati1lj1lv3d1oacphih205oo1ls0lfopf5kc24ndda7418slgj2rdmm41tua9uhj/family1/bd059ce226a349e7b6d424f2b7b387d3 into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_) 2023-03-14 10:54:45,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ati1lj1lv3d1oacphih205oo1ls0lfopf5kc24ndda7418slgj2rdmm41tua9uhj/family1/bd059ce226a349e7b6d424f2b7b387d3 2023-03-14 10:54:45,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:54:45,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:54:45,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 is initiating minor compaction 2023-03-14 10:54:45,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69c24646; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:45,117 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:45,117 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp, totalSize=50.4 K 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 9b058fd6bfc146028dfc0a630d9f272d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting de9b3c682f4b47fca45906f404fb4543, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 6d7e686f236349f3827377f1fd654280, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting f778fdd6641a45c28ad028116da06a70, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 7ae3a067dc9c47219353aed5a993808e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 58c4a48a4773406695ca75d9f6b0e6e7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 566318bcf04943e1ad4f6834e1a201a2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting c196446b86554f8382a6e66b076207a5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 49c65c9880704c4f9cb5fadb17f9d967, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:54:45,118 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 0889d24d947749588b448b1cf325fa00_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:54:45,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:45,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:45,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c87893dcddde41b4bd2eb4afc857ace7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c87893dcddde41b4bd2eb4afc857ace7 2023-03-14 10:54:45,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadeb5eb07e44a57839d44c36d0a6c85 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadeb5eb07e44a57839d44c36d0a6c85 2023-03-14 10:54:45,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601011d70c61f39c94b32ba47f44167acb563 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601011d70c61f39c94b32ba47f44167acb563 2023-03-14 10:54:45,126 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010317b75de816314a57b8029bbe7ba17c07 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010317b75de816314a57b8029bbe7ba17c07 2023-03-14 10:54:45,126 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-14 10:54:45,126 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,149 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 52038bd8d7c0b7c72eff2e24f9c5a70d#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:45,578 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/014c1289291e45bd85f985dfe1a5e17c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/014c1289291e45bd85f985dfe1a5e17c 2023-03-14 10:54:45,582 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120504b8a554125e47a49e61ee955ab923d3 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120504b8a554125e47a49e61ee955ab923d3 2023-03-14 10:54:45,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:45,584 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 of 52038bd8d7c0b7c72eff2e24f9c5a70d into 014c1289291e45bd85f985dfe1a5e17c(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:45,584 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:45,584 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678791285117; duration=0sec 2023-03-14 10:54:45,584 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:45,606 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f47857b7827449687bf185c82a4ce16 first=Optional[r00] last=Optional[r2] 2023-03-14 10:54:45,607 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f47857b7827449687bf185c82a4ce16}] 2023-03-14 10:54:45,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f47857b7827449687bf185c82a4ce16 for inclusion in 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 10:54:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f47857b7827449687bf185c82a4ce16 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2qckigmv6k58vq24inpv8pgv31aou951ef9jdkuenupj0gbl7b6n78rmnjb1vfgf/family1/1f47857b7827449687bf185c82a4ce16 2023-03-14 10:54:45,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2qckigmv6k58vq24inpv8pgv31aou951ef9jdkuenupj0gbl7b6n78rmnjb1vfgf/family1/1f47857b7827449687bf185c82a4ce16 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_ 2023-03-14 10:54:45,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2qckigmv6k58vq24inpv8pgv31aou951ef9jdkuenupj0gbl7b6n78rmnjb1vfgf/family1/1f47857b7827449687bf185c82a4ce16 into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_ - updating store file list. 2023-03-14 10:54:45,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_ into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:45,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2qckigmv6k58vq24inpv8pgv31aou951ef9jdkuenupj0gbl7b6n78rmnjb1vfgf/family1/1f47857b7827449687bf185c82a4ce16 into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_) 2023-03-14 10:54:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2qckigmv6k58vq24inpv8pgv31aou951ef9jdkuenupj0gbl7b6n78rmnjb1vfgf/family1/1f47857b7827449687bf185c82a4ce16 2023-03-14 10:54:45,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:54:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:54:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 is initiating minor compaction (all files) 2023-03-14 10:54:45,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3add2ccf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:45,622 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:45,622 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/014c1289291e45bd85f985dfe1a5e17c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp, totalSize=390.1 K 2023-03-14 10:54:45,623 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 0af78b7ab02e4e4997854374b307bc27, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:54:45,623 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 014c1289291e45bd85f985dfe1a5e17c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:54:45,624 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878837821 2023-03-14 10:54:45,624 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:45,625 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:45,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130da11a9c29d2a4448a86f04d07a9d1559 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130da11a9c29d2a4448a86f04d07a9d1559 2023-03-14 10:54:45,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201239d9d3ae5b244509a6b611c407bc1a4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201239d9d3ae5b244509a6b611c407bc1a4 2023-03-14 10:54:45,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a250d0be3ee04ee28b385120b7900d15 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a250d0be3ee04ee28b385120b7900d15 2023-03-14 10:54:45,629 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-14 10:54:45,629 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 10:54:45,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:45,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:45,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:45,631 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:45,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4170 sec 2023-03-14 10:54:45,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_] to archive 2023-03-14 10:54:45,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:45,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9b058fd6bfc146028dfc0a630d9f272d 2023-03-14 10:54:45,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/de9b3c682f4b47fca45906f404fb4543 2023-03-14 10:54:45,652 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 52038bd8d7c0b7c72eff2e24f9c5a70d#family1#compaction#62 average throughput is 16.42 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:54:45,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/6d7e686f236349f3827377f1fd654280 2023-03-14 10:54:45,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/f778fdd6641a45c28ad028116da06a70 2023-03-14 10:54:45,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/7ae3a067dc9c47219353aed5a993808e 2023-03-14 10:54:45,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/58c4a48a4773406695ca75d9f6b0e6e7 2023-03-14 10:54:45,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/566318bcf04943e1ad4f6834e1a201a2 2023-03-14 10:54:45,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/c196446b86554f8382a6e66b076207a5 2023-03-14 10:54:45,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/49c65c9880704c4f9cb5fadb17f9d967 2023-03-14 10:54:45,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0889d24d947749588b448b1cf325fa00_SeqId_44_ 2023-03-14 10:54:45,687 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/.tmp/family1/9775d87f8ce641b0a191a22ebaf4b068 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9775d87f8ce641b0a191a22ebaf4b068 2023-03-14 10:54:45,690 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-03-14 10:54:45,693 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 of 52038bd8d7c0b7c72eff2e24f9c5a70d into 9775d87f8ce641b0a191a22ebaf4b068(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:54:45,694 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:45,694 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678791285622; duration=0sec 2023-03-14 10:54:45,694 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:54:45,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/014c1289291e45bd85f985dfe1a5e17c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_] to archive 2023-03-14 10:54:45,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 10:54:45,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:45,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:45,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/0af78b7ab02e4e4997854374b307bc27 2023-03-14 10:54:45,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/014c1289291e45bd85f985dfe1a5e17c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/014c1289291e45bd85f985dfe1a5e17c 2023-03-14 10:54:45,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/d2db04553b3b4876bdddaf0faf2d0942_SeqId_47_ 2023-03-14 10:54:46,145 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 10:54:46,146 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:46,146 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 10:54:46,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-14 10:54:46,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE}] 2023-03-14 10:54:46,151 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE 2023-03-14 10:54:46,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:46,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791286152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791286152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791286152"}]},"ts":"1678791286152"} 2023-03-14 10:54:46,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:46,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52038bd8d7c0b7c72eff2e24f9c5a70d, disabling compactions & flushes 2023-03-14 10:54:46,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. after waiting 0 ms 2023-03-14 10:54:46,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 10:54:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:46,312 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 52038bd8d7c0b7c72eff2e24f9c5a70d to self. 2023-03-14 10:54:46,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=CLOSED 2023-03-14 10:54:46,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791286314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791286314"}]},"ts":"1678791286314"} 2023-03-14 10:54:46,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-14 10:54:46,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 161 msec 2023-03-14 10:54:46,317 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=true 2023-03-14 10:54:46,467 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:46,468 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791286467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791286467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791286467"}]},"ts":"1678791286467"} 2023-03-14 10:54:46,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:46,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52038bd8d7c0b7c72eff2e24f9c5a70d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:46,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:46,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,626 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,627 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:46,627 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:46,627 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52038bd8d7c0b7c72eff2e24f9c5a70d columnFamilyName family1 2023-03-14 10:54:46,631 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9775d87f8ce641b0a191a22ebaf4b068 2023-03-14 10:54:46,632 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(310): Store=52038bd8d7c0b7c72eff2e24f9c5a70d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:46,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:46,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52038bd8d7c0b7c72eff2e24f9c5a70d; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70034890, jitterRate=0.04360118508338928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:46,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:46,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., pid=47, masterSystemTime=1678791286621 2023-03-14 10:54:46,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:46,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:46,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791286640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791286640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791286640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791286640"}]},"ts":"1678791286640"} 2023-03-14 10:54:46,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-14 10:54:46,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 172 msec 2023-03-14 10:54:46,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-14 10:54:46,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE in 491 msec 2023-03-14 10:54:46,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-14 10:54:46,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-03-14 10:54:46,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-03-14 10:54:46,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-14 10:54:46,649 INFO [Listener at localhost/44023] compactions.TestMobCompactor(278): alter status finished 2023-03-14 10:54:46,650 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:46,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:46,652 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:46,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:46,652 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791886652 2023-03-14 10:54:46,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:46,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 10:54:46,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:46,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x11047664 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:46,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f828d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:46,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:46,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:46,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:46,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:46,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:47,491 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112842444477572b42319c99e67498633e3d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112842444477572b42319c99e67498633e3d 2023-03-14 10:54:47,492 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:47,505 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:54:47,506 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:54:47,512 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:54:47,514 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:54:47,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a30f01552a54b7894c02e8a1cb016ab first=Optional[r05] last=Optional[r8] 2023-03-14 10:54:47,523 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a30f01552a54b7894c02e8a1cb016ab}] 2023-03-14 10:54:47,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a30f01552a54b7894c02e8a1cb016ab for inclusion in 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 10:54:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:54:47,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:47,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a30f01552a54b7894c02e8a1cb016ab to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qjb8qeri9ag23s9i68uheoclak7fvhs8i4qe6usindlh7v4f1svrt9tj8j5phgok/family1/4a30f01552a54b7894c02e8a1cb016ab 2023-03-14 10:54:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qjb8qeri9ag23s9i68uheoclak7fvhs8i4qe6usindlh7v4f1svrt9tj8j5phgok/family1/4a30f01552a54b7894c02e8a1cb016ab as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/2533aeec1871477f8d893f1efaaccbae_SeqId_53_ 2023-03-14 10:54:47,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qjb8qeri9ag23s9i68uheoclak7fvhs8i4qe6usindlh7v4f1svrt9tj8j5phgok/family1/4a30f01552a54b7894c02e8a1cb016ab into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/2533aeec1871477f8d893f1efaaccbae_SeqId_53_ - updating store file list. 2023-03-14 10:54:47,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/2533aeec1871477f8d893f1efaaccbae_SeqId_53_ into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:47,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qjb8qeri9ag23s9i68uheoclak7fvhs8i4qe6usindlh7v4f1svrt9tj8j5phgok/family1/4a30f01552a54b7894c02e8a1cb016ab into 52038bd8d7c0b7c72eff2e24f9c5a70d/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/2533aeec1871477f8d893f1efaaccbae_SeqId_53_) 2023-03-14 10:54:47,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qjb8qeri9ag23s9i68uheoclak7fvhs8i4qe6usindlh7v4f1svrt9tj8j5phgok/family1/4a30f01552a54b7894c02e8a1cb016ab 2023-03-14 10:54:47,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:47,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:54:47,541 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf8db7544a0141b8bad017d2bf7fffd6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120bf8db7544a0141b8bad017d2bf7fffd6 2023-03-14 10:54:47,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112840c8b3cf0d9e4fd29bbb0890c9dfca43 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112840c8b3cf0d9e4fd29bbb0890c9dfca43 2023-03-14 10:54:47,542 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-14 10:54:47,542 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 10:54:47,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:47,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:47,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:47,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:47,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:47,544 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:47,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 893 msec 2023-03-14 10:54:47,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:54:47,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:48,004 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-14 10:54:48,006 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 10:54:48,006 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-14 10:54:48,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-14 10:54:48,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE}] 2023-03-14 10:54:48,012 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE 2023-03-14 10:54:48,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:48,013 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791288012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791288012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791288012"}]},"ts":"1678791288012"} 2023-03-14 10:54:48,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:48,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52038bd8d7c0b7c72eff2e24f9c5a70d, disabling compactions & flushes 2023-03-14 10:54:48,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. after waiting 0 ms 2023-03-14 10:54:48,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-14 10:54:48,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:48,173 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 52038bd8d7c0b7c72eff2e24f9c5a70d to self. 2023-03-14 10:54:48,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,175 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=CLOSED 2023-03-14 10:54:48,175 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791288175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791288175"}]},"ts":"1678791288175"} 2023-03-14 10:54:48,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-14 10:54:48,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 162 msec 2023-03-14 10:54:48,178 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=true 2023-03-14 10:54:48,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:48,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791288328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791288328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791288328"}]},"ts":"1678791288328"} 2023-03-14 10:54:48,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:48,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52038bd8d7c0b7c72eff2e24f9c5a70d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:48,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:48,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,486 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,487 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:48,487 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1 2023-03-14 10:54:48,487 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52038bd8d7c0b7c72eff2e24f9c5a70d columnFamilyName family1 2023-03-14 10:54:48,492 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/2533aeec1871477f8d893f1efaaccbae_SeqId_53_ 2023-03-14 10:54:48,495 DEBUG [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/family1/9775d87f8ce641b0a191a22ebaf4b068 2023-03-14 10:54:48,496 INFO [StoreOpener-52038bd8d7c0b7c72eff2e24f9c5a70d-1] regionserver.HStore(310): Store=52038bd8d7c0b7c72eff2e24f9c5a70d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:48,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:54:48,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52038bd8d7c0b7c72eff2e24f9c5a70d; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69812708, jitterRate=0.04029041528701782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:48,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:54:48,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d., pid=53, masterSystemTime=1678791288482 2023-03-14 10:54:48,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:54:48,503 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=52038bd8d7c0b7c72eff2e24f9c5a70d, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:48,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678791288503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791288503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791288503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791288503"}]},"ts":"1678791288503"} 2023-03-14 10:54:48,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-14 10:54:48,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 52038bd8d7c0b7c72eff2e24f9c5a70d, server=jenkins-hbase4.apache.org,36455,1678791214611 in 174 msec 2023-03-14 10:54:48,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-14 10:54:48,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=52038bd8d7c0b7c72eff2e24f9c5a70d, REOPEN/MOVE in 494 msec 2023-03-14 10:54:48,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-14 10:54:48,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 499 msec 2023-03-14 10:54:48,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 916 msec 2023-03-14 10:54:48,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-14 10:54:48,512 INFO [Listener at localhost/44023] compactions.TestMobCompactor(278): alter status finished 2023-03-14 10:54:48,513 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 10:54:48,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:48,515 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:48,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:48,515 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791888515 2023-03-14 10:54:48,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:48,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 10:54:48,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:48,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x10545512 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:48,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49b34160, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:48,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,522 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 10:54:48,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 10:54:48,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:48,523 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 10:54:48,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-03-14 10:54:48,567 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=242 (was 255), OpenFileDescriptor=607 (was 622), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 243), ProcessCount=169 (was 169), AvailableMemoryMB=2809 (was 2854) 2023-03-14 10:54:48,577 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=169, AvailableMemoryMB=2809 2023-03-14 10:54:48,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 10:54:48,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:48,581 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:54:48,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-14 10:54:48,582 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:54:48,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:48,583 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:48,584 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 empty. 2023-03-14 10:54:48,584 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:48,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-14 10:54:48,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:48,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:48,993 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-14 10:54:48,994 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 639896e65719e698ba00c8e74c2bb4e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:54:49,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 639896e65719e698ba00c8e74c2bb4e8, disabling compactions & flushes 2023-03-14 10:54:49,400 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. after waiting 0 ms 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,400 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,400 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:49,403 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:54:49,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791289403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791289403"}]},"ts":"1678791289403"} 2023-03-14 10:54:49,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:54:49,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:54:49,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791289405"}]},"ts":"1678791289405"} 2023-03-14 10:54:49,406 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-14 10:54:49,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, ASSIGN}] 2023-03-14 10:54:49,410 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, ASSIGN 2023-03-14 10:54:49,411 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:54:49,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:49,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791289562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791289562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791289562"}]},"ts":"1678791289562"} 2023-03-14 10:54:49,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:54:49,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:49,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 639896e65719e698ba00c8e74c2bb4e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:54:49,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:54:49,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,720 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,721 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:54:49,721 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:54:49,722 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 639896e65719e698ba00c8e74c2bb4e8 columnFamilyName family1 2023-03-14 10:54:49,723 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(310): Store=639896e65719e698ba00c8e74c2bb4e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:54:49,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:54:49,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:54:49,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 639896e65719e698ba00c8e74c2bb4e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70221532, jitterRate=0.046382367610931396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:54:49,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:49,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., pid=57, masterSystemTime=1678791289715 2023-03-14 10:54:49,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:49,734 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:49,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791289734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791289734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791289734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791289734"}]},"ts":"1678791289734"} 2023-03-14 10:54:49,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-14 10:54:49,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611 in 171 msec 2023-03-14 10:54:49,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-14 10:54:49,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, ASSIGN in 327 msec 2023-03-14 10:54:49,738 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:54:49,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791289738"}]},"ts":"1678791289738"} 2023-03-14 10:54:49,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-14 10:54:49,742 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:54:49,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1630 sec 2023-03-14 10:54:50,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 10:54:50,687 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-14 10:54:50,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:50,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,712 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:50,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:50,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:50,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:50,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,712 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,714 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:50,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:50,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:50,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,714 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:50,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:50,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:50,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:50,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:50,715 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:50,720 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:50,720 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:50,720 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:50,720 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:50,721 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:54:51,144 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cca670a4a3624edd962853a6daa1fbaa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cca670a4a3624edd962853a6daa1fbaa 2023-03-14 10:54:51,548 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d 2023-03-14 10:54:51,553 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d 2023-03-14 10:54:51,558 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-14 10:54:51,559 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 839ms, sequenceid=5, compaction requested=false 2023-03-14 10:54:51,559 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:51,560 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:51,560 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:51,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:51,561 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,561 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:51,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:51,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@752e651f[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:51,563 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:51,564 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,565 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:51,565 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:51,565 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,565 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:51,567 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:51,567 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:51,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:51,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:51,569 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:51,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:51,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:51,569 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,569 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:51,571 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,571 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,571 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:51,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:51,571 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:51,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,572 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:51,579 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:51,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:51,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:51,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:51,579 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,580 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:51,580 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:51,680 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:51,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:51,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:51,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:51,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,687 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:51,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:51,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:51,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:51,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,687 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,690 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:51,690 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:51,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:51,690 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:51,690 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:51,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:51,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,691 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:51,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:51,691 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:51,691 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:51,691 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:51,693 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:54:51,849 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:54:52,106 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281687e241078a4e0199ec923db256f45a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511281687e241078a4e0199ec923db256f45a 2023-03-14 10:54:52,511 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/a4b5dc94d95d4645aa350336688fe58f 2023-03-14 10:54:52,516 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/a4b5dc94d95d4645aa350336688fe58f as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f 2023-03-14 10:54:52,520 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:54:52,521 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 828ms, sequenceid=9, compaction requested=false 2023-03-14 10:54:52,521 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:52,521 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:52,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:52,523 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,523 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ce0b722[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:52,525 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:52,525 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,526 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:52,526 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,526 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:52,527 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:52,527 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:52,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:52,530 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:52,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:52,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:52,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,530 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:52,533 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,533 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,533 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:52,533 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,534 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,536 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:52,536 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:52,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:52,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:52,537 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:52,537 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:52,637 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:52,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:52,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:52,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:52,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,643 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:52,643 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:52,643 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:52,643 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:52,644 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,644 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,645 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:52,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:52,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:52,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:52,646 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:52,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:52,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:52,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:52,647 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:52,648 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:52,648 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:53,060 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201041330df41e2443eaad78f2a12590f4b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201041330df41e2443eaad78f2a12590f4b 2023-03-14 10:54:53,466 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/40a02d02d58d42e4b0bd8c7cc86bb3db 2023-03-14 10:54:53,471 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/40a02d02d58d42e4b0bd8c7cc86bb3db as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db 2023-03-14 10:54:53,475 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 10:54:53,476 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 828ms, sequenceid=13, compaction requested=true 2023-03-14 10:54:53,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:53,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:53,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:53,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:53,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:53,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:53,477 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,477 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:53,478 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,478 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:53,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:53,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34bf8713[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:53,479 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:53,479 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,481 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,481 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,481 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:53,481 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:53,481 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:53,481 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:53,482 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:53,483 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:53,483 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,483 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:53,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:53,485 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:53,485 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:53,485 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:53,485 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,485 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:53,487 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,487 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:53,487 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:53,487 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,488 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,490 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,490 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:53,490 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:53,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:53,490 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,491 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:53,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:53,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:53,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,591 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:53,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:53,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:53,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:53,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,597 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:53,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:53,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:53,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:53,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,598 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,600 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,600 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:53,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:53,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:53,600 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:53,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,600 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:53,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:53,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,601 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:53,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:53,602 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:53,602 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:53,602 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:54,018 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e5dcbf86620d40dd8408a857e36e1f9f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5dcbf86620d40dd8408a857e36e1f9f 2023-03-14 10:54:54,423 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/cf5c19a155574816a635a8553105429a 2023-03-14 10:54:54,428 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/cf5c19a155574816a635a8553105429a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a 2023-03-14 10:54:54,432 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 10:54:54,433 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 831ms, sequenceid=17, compaction requested=true 2023-03-14 10:54:54,433 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:54,433 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:54,433 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:54,435 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,435 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:54,435 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,435 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:54,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34849500[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:54,437 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:54,437 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,440 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:54,440 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:54,440 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:54,442 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:54,442 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:54,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:54,445 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:54,445 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:54,445 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:54,445 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,445 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:54,446 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,446 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:54,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,446 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,447 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:54,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,448 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:54,450 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:54,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:54,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:54,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:54,450 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:54,550 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:54,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:54,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:54,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:54,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,556 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:54,556 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:54,556 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:54,556 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:54,557 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,557 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,558 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,558 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:54,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:54,558 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:54,558 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:54,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:54,559 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:54,559 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:54,564 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:54,564 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:54,564 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:54,564 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:54,564 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:54,978 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ec0771fbe4c445d794069d49bd701174 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec0771fbe4c445d794069d49bd701174 2023-03-14 10:54:55,385 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/0e443c0010024b7183e78e0495b5212e 2023-03-14 10:54:55,390 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/0e443c0010024b7183e78e0495b5212e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e 2023-03-14 10:54:55,394 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 10:54:55,395 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 831ms, sequenceid=21, compaction requested=true 2023-03-14 10:54:55,395 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:55,395 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:55,395 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:55,397 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,397 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,398 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:55,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32041812[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:55,399 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:55,399 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,400 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:55,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:55,400 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,401 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:55,402 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:55,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:55,404 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:55,404 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:55,404 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:55,404 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,404 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:55,406 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,406 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,406 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,406 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:55,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,407 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:55,410 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:55,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:55,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:55,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,410 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,411 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,411 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:55,411 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:55,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:55,511 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:55,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:55,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:55,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:55,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,517 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:55,517 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:55,517 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:55,517 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:55,517 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,518 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,519 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:55,519 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:55,519 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,519 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:55,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:55,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:55,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:55,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:55,521 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:55,521 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:55,521 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:55,521 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:55,941 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c689fea1885d414f94c410ceb2834f9d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c689fea1885d414f94c410ceb2834f9d 2023-03-14 10:54:55,949 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/54aab644a68c42cb95e9fdb894eb6c7e 2023-03-14 10:54:55,954 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/54aab644a68c42cb95e9fdb894eb6c7e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e 2023-03-14 10:54:55,958 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 10:54:55,959 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 438ms, sequenceid=25, compaction requested=true 2023-03-14 10:54:55,959 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:55,959 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:55,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:55,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:55,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:55,959 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:55,961 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,961 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bf4e0d7[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:55,962 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:55,963 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,964 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:55,964 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:55,964 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:55,966 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:55,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:55,969 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:55,969 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:55,969 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:55,969 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,969 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:55,972 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,972 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,972 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:55,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:55,972 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,973 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:55,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:55,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:55,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:55,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:55,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:55,978 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:55,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:55,979 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,079 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:56,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:56,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:56,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:56,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,086 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:56,086 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:56,086 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:56,086 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:56,086 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,086 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,091 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,091 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:56,091 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,091 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:56,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:56,093 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:56,093 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:56,093 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:56,507 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010183503be3155544528337a8b10a662e92 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010183503be3155544528337a8b10a662e92 2023-03-14 10:54:56,912 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/4845393c55e24977bf5f94d1aa462168 2023-03-14 10:54:56,917 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/4845393c55e24977bf5f94d1aa462168 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168 2023-03-14 10:54:56,922 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 10:54:56,923 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 830ms, sequenceid=29, compaction requested=true 2023-03-14 10:54:56,923 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:56,923 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:56,923 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:56,923 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:56,923 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,923 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:56,923 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:56,924 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,924 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:56,925 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,925 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:56,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:56,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@533b6ba5[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:56,926 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:56,926 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,927 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,928 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:56,928 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:56,928 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:56,928 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,928 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:56,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:56,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:56,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:56,930 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:56,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:56,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:56,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:56,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:56,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:56,932 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:56,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:56,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:56,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,932 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:56,933 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,933 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,934 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:56,934 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,935 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:56,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:56,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:56,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:56,937 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:56,938 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:56,937 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:56,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:56,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:56,938 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,938 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:56,938 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,038 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:57,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:57,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:57,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:57,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,045 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:57,045 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:57,045 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:57,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:57,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,048 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,048 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:57,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:57,048 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,048 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:57,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,049 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:57,049 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:57,049 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:57,057 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:57,057 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:57,057 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:57,074 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039afb02d623284e80b241f2cdeb65ae43 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039afb02d623284e80b241f2cdeb65ae43 2023-03-14 10:54:57,479 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/b22067da8e7b4a2e9cc179d5a38205cd 2023-03-14 10:54:57,483 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/b22067da8e7b4a2e9cc179d5a38205cd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd 2023-03-14 10:54:57,487 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 10:54:57,488 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 431ms, sequenceid=33, compaction requested=true 2023-03-14 10:54:57,488 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:57,488 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:57,488 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:57,489 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:57,491 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,491 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:57,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:57,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:57,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:57,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4387c857[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:57,493 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:57,493 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,494 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:57,495 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,495 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:57,495 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:57,496 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:57,496 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:57,496 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,496 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:57,498 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:57,498 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:57,498 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:57,498 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,498 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:57,500 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,500 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:57,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,500 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:57,500 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,502 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:57,505 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:57,505 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:57,506 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:57,606 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:57,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:57,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:57,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,612 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:57,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:57,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:57,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:57,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,614 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:57,614 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:57,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:57,614 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:57,614 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:57,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:57,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:57,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:57,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:57,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:57,616 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:57,616 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:57,616 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:57,616 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:58,032 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907985e1ad95e4d4b37b0edb301dadf6ead to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907985e1ad95e4d4b37b0edb301dadf6ead 2023-03-14 10:54:58,446 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/343fcabbf12943d1aaccde13a3b8ae74 2023-03-14 10:54:58,451 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/343fcabbf12943d1aaccde13a3b8ae74 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74 2023-03-14 10:54:58,455 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 10:54:58,456 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 840ms, sequenceid=37, compaction requested=true 2023-03-14 10:54:58,457 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:58,457 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,458 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:58,459 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,459 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:58,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:58,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51518cbd[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:58,460 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:58,461 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,463 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,463 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,463 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:58,465 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:58,465 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:58,465 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,465 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:58,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:58,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:58,467 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:58,467 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:58,467 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:58,467 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,468 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:58,469 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,469 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:58,469 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:58,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:58,470 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,471 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,473 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:58,473 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:58,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:58,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:58,473 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 10:54:58,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:58,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:58,473 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:58,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:58,474 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:58,574 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:58,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:58,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:54:58,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 10:54:58,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,581 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:58,581 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:58,581 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 10:54:58,581 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 10:54:58,581 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,581 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,583 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:58,583 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:58,584 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:58,584 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:54:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:54:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 10:54:58,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 10:54:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:54:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 10:54:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:54:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:54:58,585 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:58,585 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. started... 2023-03-14 10:54:58,585 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 639896e65719e698ba00c8e74c2bb4e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:54:58,996 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120de0f9ab85fd54d16a257306aa2bf0790 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120de0f9ab85fd54d16a257306aa2bf0790 2023-03-14 10:54:59,402 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/f474edf13af64f3591a394ee9cc8fec2 2023-03-14 10:54:59,406 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/f474edf13af64f3591a394ee9cc8fec2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2 2023-03-14 10:54:59,410 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 10:54:59,411 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 639896e65719e698ba00c8e74c2bb4e8 in 826ms, sequenceid=41, compaction requested=true 2023-03-14 10:54:59,411 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:54:59,411 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:54:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:54:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:54:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 10:54:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 10:54:59,413 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:54:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:59,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 10:54:59,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d9f2c18[Count = 0] remaining members to acquire global barrier 2023-03-14 10:54:59,415 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 10:54:59,415 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,416 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,416 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 10:54:59,416 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 10:54:59,416 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:54:59,416 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,416 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:54:59,417 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 10:54:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:59,417 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 10:54:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:54:59,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 10:54:59,419 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 10:54:59,420 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:54:59,420 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:54:59,420 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,420 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:54:59,426 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,426 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:54:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:54:59,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,426 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:59,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:54:59,427 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:54:59,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,428 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:54:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:54:59,430 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 10:54:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:54:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 10:54:59,430 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:54:59,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:54:59,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:54:59,530 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:54:59,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:54:59,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:54:59,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:54:59,535 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:54:59,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:54:59,535 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791899535 2023-03-14 10:54:59,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:54:59,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 10:54:59,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:54:59,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x17c31fad to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:54:59,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57238f22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:54:59,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,379 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036d2452b9d63a43f1aa63a93f0c534481 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036d2452b9d63a43f1aa63a93f0c534481 2023-03-14 10:55:00,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:00,393 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:00,394 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:00,401 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:00,402 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:00,409 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8b35a9ba14e34d55a58a841e845b56da first=Optional[r3] last=Optional[r6] 2023-03-14 10:55:00,410 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8b35a9ba14e34d55a58a841e845b56da}] 2023-03-14 10:55:00,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8b35a9ba14e34d55a58a841e845b56da for inclusion in 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 10:55:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:55:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:00,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8b35a9ba14e34d55a58a841e845b56da to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sl77g8em4b2o7281j5gc5nuenfeqsusvnvu1d6pqjjnap0bpif4vte9k39icgnfs/family1/8b35a9ba14e34d55a58a841e845b56da 2023-03-14 10:55:00,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sl77g8em4b2o7281j5gc5nuenfeqsusvnvu1d6pqjjnap0bpif4vte9k39icgnfs/family1/8b35a9ba14e34d55a58a841e845b56da as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_ 2023-03-14 10:55:00,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sl77g8em4b2o7281j5gc5nuenfeqsusvnvu1d6pqjjnap0bpif4vte9k39icgnfs/family1/8b35a9ba14e34d55a58a841e845b56da into 639896e65719e698ba00c8e74c2bb4e8/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_ - updating store file list. 2023-03-14 10:55:00,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_ into 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:00,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sl77g8em4b2o7281j5gc5nuenfeqsusvnvu1d6pqjjnap0bpif4vte9k39icgnfs/family1/8b35a9ba14e34d55a58a841e845b56da into 639896e65719e698ba00c8e74c2bb4e8/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_) 2023-03-14 10:55:00,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sl77g8em4b2o7281j5gc5nuenfeqsusvnvu1d6pqjjnap0bpif4vte9k39icgnfs/family1/8b35a9ba14e34d55a58a841e845b56da 2023-03-14 10:55:00,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:55:00,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:55:00,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 639896e65719e698ba00c8e74c2bb4e8/family1 is initiating minor compaction 2023-03-14 10:55:00,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@25d5bcf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:00,427 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 639896e65719e698ba00c8e74c2bb4e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:00,427 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp, totalSize=50.3 K 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting a4b5dc94d95d4645aa350336688fe58f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 40a02d02d58d42e4b0bd8c7cc86bb3db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting cf5c19a155574816a635a8553105429a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 0e443c0010024b7183e78e0495b5212e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 54aab644a68c42cb95e9fdb894eb6c7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:55:00,427 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 4845393c55e24977bf5f94d1aa462168, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:55:00,428 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b22067da8e7b4a2e9cc179d5a38205cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:55:00,428 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 343fcabbf12943d1aaccde13a3b8ae74, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:55:00,428 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting f474edf13af64f3591a394ee9cc8fec2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:55:00,428 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:55:00,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:00,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:00,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec0771fbe4c445d794069d49bd701174 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ec0771fbe4c445d794069d49bd701174 2023-03-14 10:55:00,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c689fea1885d414f94c410ceb2834f9d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c689fea1885d414f94c410ceb2834f9d 2023-03-14 10:55:00,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010183503be3155544528337a8b10a662e92 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010183503be3155544528337a8b10a662e92 2023-03-14 10:55:00,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039afb02d623284e80b241f2cdeb65ae43 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039afb02d623284e80b241f2cdeb65ae43 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-14 10:55:00,435 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,435 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,461 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 639896e65719e698ba00c8e74c2bb4e8#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:00,881 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120578483d2948ee4f6ab31e5e782ac58f7e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120578483d2948ee4f6ab31e5e782ac58f7e 2023-03-14 10:55:00,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:00,905 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c18571932e3e405592c380d32185136e first=Optional[r00] last=Optional[r2] 2023-03-14 10:55:00,906 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c18571932e3e405592c380d32185136e}] 2023-03-14 10:55:00,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c18571932e3e405592c380d32185136e for inclusion in 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:00,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 10:55:00,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:55:00,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:00,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c18571932e3e405592c380d32185136e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v99qkki97aqf1vdem5s4dktagch2jtvbtsb7t0jdfj0sj89fom58io5pnalchdv2/family1/c18571932e3e405592c380d32185136e 2023-03-14 10:55:00,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v99qkki97aqf1vdem5s4dktagch2jtvbtsb7t0jdfj0sj89fom58io5pnalchdv2/family1/c18571932e3e405592c380d32185136e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ 2023-03-14 10:55:00,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v99qkki97aqf1vdem5s4dktagch2jtvbtsb7t0jdfj0sj89fom58io5pnalchdv2/family1/c18571932e3e405592c380d32185136e into 639896e65719e698ba00c8e74c2bb4e8/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ - updating store file list. 2023-03-14 10:55:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ into 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v99qkki97aqf1vdem5s4dktagch2jtvbtsb7t0jdfj0sj89fom58io5pnalchdv2/family1/c18571932e3e405592c380d32185136e into 639896e65719e698ba00c8e74c2bb4e8/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_) 2023-03-14 10:55:00,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v99qkki97aqf1vdem5s4dktagch2jtvbtsb7t0jdfj0sj89fom58io5pnalchdv2/family1/c18571932e3e405592c380d32185136e 2023-03-14 10:55:00,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:00,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:00,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cca670a4a3624edd962853a6daa1fbaa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cca670a4a3624edd962853a6daa1fbaa 2023-03-14 10:55:00,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201041330df41e2443eaad78f2a12590f4b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201041330df41e2443eaad78f2a12590f4b 2023-03-14 10:55:00,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5dcbf86620d40dd8408a857e36e1f9f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5dcbf86620d40dd8408a857e36e1f9f 2023-03-14 10:55:00,925 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-14 10:55:00,925 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 10:55:00,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:00,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:00,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:00,927 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:00,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.3940 sec 2023-03-14 10:55:01,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 10:55:01,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:55:01,276 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/b0f5ad40c6ab475581b31a46f0084a05 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05 2023-03-14 10:55:01,280 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 639896e65719e698ba00c8e74c2bb4e8/family1 of 639896e65719e698ba00c8e74c2bb4e8 into b0f5ad40c6ab475581b31a46f0084a05(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:01,280 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:01,280 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678791300427; duration=0sec 2023-03-14 10:55:01,280 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:01,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_] to archive 2023-03-14 10:55:01,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:01,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a4b5dc94d95d4645aa350336688fe58f 2023-03-14 10:55:01,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/40a02d02d58d42e4b0bd8c7cc86bb3db 2023-03-14 10:55:01,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/cf5c19a155574816a635a8553105429a 2023-03-14 10:55:01,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/0e443c0010024b7183e78e0495b5212e 2023-03-14 10:55:01,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/54aab644a68c42cb95e9fdb894eb6c7e 2023-03-14 10:55:01,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/4845393c55e24977bf5f94d1aa462168 2023-03-14 10:55:01,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b22067da8e7b4a2e9cc179d5a38205cd 2023-03-14 10:55:01,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/343fcabbf12943d1aaccde13a3b8ae74 2023-03-14 10:55:01,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/f474edf13af64f3591a394ee9cc8fec2 2023-03-14 10:55:01,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/1f0a415db89b4ae794cb5dd1b98867ca_SeqId_44_ 2023-03-14 10:55:01,426 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 10:55:01,427 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:01,427 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 10:55:01,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-14 10:55:01,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE}] 2023-03-14 10:55:01,432 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE 2023-03-14 10:55:01,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:01,433 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791301433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791301433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791301433"}]},"ts":"1678791301433"} 2023-03-14 10:55:01,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:01,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 639896e65719e698ba00c8e74c2bb4e8, disabling compactions & flushes 2023-03-14 10:55:01,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. after waiting 0 ms 2023-03-14 10:55:01,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-14 10:55:01,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:01,593 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 639896e65719e698ba00c8e74c2bb4e8 to self. 2023-03-14 10:55:01,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=CLOSED 2023-03-14 10:55:01,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791301595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791301595"}]},"ts":"1678791301595"} 2023-03-14 10:55:01,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-14 10:55:01,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611 in 162 msec 2023-03-14 10:55:01,598 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=true 2023-03-14 10:55:01,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:01,749 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791301748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791301748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791301748"}]},"ts":"1678791301748"} 2023-03-14 10:55:01,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:01,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 639896e65719e698ba00c8e74c2bb4e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:55:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,906 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,907 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:01,907 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:01,908 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 639896e65719e698ba00c8e74c2bb4e8 columnFamilyName family1 2023-03-14 10:55:01,912 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ 2023-03-14 10:55:01,916 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05 2023-03-14 10:55:01,919 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d 2023-03-14 10:55:01,919 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(310): Store=639896e65719e698ba00c8e74c2bb4e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:01,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:01,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 639896e65719e698ba00c8e74c2bb4e8; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68724864, jitterRate=0.024080276489257812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:55:01,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:01,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., pid=63, masterSystemTime=1678791301902 2023-03-14 10:55:01,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:01,926 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 10:55:01,927 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 10:55:01,927 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1912): 639896e65719e698ba00c8e74c2bb4e8/family1 is initiating minor compaction (all files) 2023-03-14 10:55:01,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,927 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 639896e65719e698ba00c8e74c2bb4e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:01,928 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp, totalSize=388.1 K 2023-03-14 10:55:01,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:01,928 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting e2c2acf73e2a44cc9caf7a4c106d2b4d, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:55:01,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791301928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791301928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791301928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791301928"}]},"ts":"1678791301928"} 2023-03-14 10:55:01,928 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b0f5ad40c6ab475581b31a46f0084a05, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:55:01,929 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 9821d16a283b4e27961e941c0c8247a0_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878837821 2023-03-14 10:55:01,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-14 10:55:01,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611 in 179 msec 2023-03-14 10:55:01,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-14 10:55:01,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE in 500 msec 2023-03-14 10:55:01,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-14 10:55:01,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 504 msec 2023-03-14 10:55:01,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 920 msec 2023-03-14 10:55:01,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-14 10:55:01,939 INFO [Listener at localhost/44023] compactions.TestMobCompactor(278): alter status finished 2023-03-14 10:55:01,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:55:01,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:01,942 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:01,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:01,943 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791901943 2023-03-14 10:55:01,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:55:01,944 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 639896e65719e698ba00c8e74c2bb4e8#family1#compaction#74 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:01,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 10:55:01,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:01,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x54faf85c to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:01,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f8b00a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:01,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:01,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:01,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:01,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:01,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:02,789 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128598fa8154a64400fa2ff1deb1bb2a9a1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128598fa8154a64400fa2ff1deb1bb2a9a1 2023-03-14 10:55:02,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:02,804 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:02,805 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:02,811 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:02,813 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33884, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:02,821 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a20bc0db83b4ed9bf1a62e7f882320e first=Optional[r05] last=Optional[r8] 2023-03-14 10:55:02,821 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=50 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a20bc0db83b4ed9bf1a62e7f882320e}] 2023-03-14 10:55:02,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a20bc0db83b4ed9bf1a62e7f882320e for inclusion in 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 10:55:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:55:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:02,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8a20bc0db83b4ed9bf1a62e7f882320e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__phavsvvt67km9fca30ocp09uuqtom6nhkga2kutesd0bg6nbjh7nfls0ig1ao57v/family1/8a20bc0db83b4ed9bf1a62e7f882320e 2023-03-14 10:55:02,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__phavsvvt67km9fca30ocp09uuqtom6nhkga2kutesd0bg6nbjh7nfls0ig1ao57v/family1/8a20bc0db83b4ed9bf1a62e7f882320e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a3734edafc6f4d15ad83efbbc753cb1e_SeqId_52_ 2023-03-14 10:55:02,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__phavsvvt67km9fca30ocp09uuqtom6nhkga2kutesd0bg6nbjh7nfls0ig1ao57v/family1/8a20bc0db83b4ed9bf1a62e7f882320e into 639896e65719e698ba00c8e74c2bb4e8/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a3734edafc6f4d15ad83efbbc753cb1e_SeqId_52_ - updating store file list. 2023-03-14 10:55:02,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a3734edafc6f4d15ad83efbbc753cb1e_SeqId_52_ into 639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:02,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__phavsvvt67km9fca30ocp09uuqtom6nhkga2kutesd0bg6nbjh7nfls0ig1ao57v/family1/8a20bc0db83b4ed9bf1a62e7f882320e into 639896e65719e698ba00c8e74c2bb4e8/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a3734edafc6f4d15ad83efbbc753cb1e_SeqId_52_) 2023-03-14 10:55:02,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__phavsvvt67km9fca30ocp09uuqtom6nhkga2kutesd0bg6nbjh7nfls0ig1ao57v/family1/8a20bc0db83b4ed9bf1a62e7f882320e 2023-03-14 10:55:02,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:02,838 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:02,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120de0f9ab85fd54d16a257306aa2bf0790 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120de0f9ab85fd54d16a257306aa2bf0790 2023-03-14 10:55:02,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511281687e241078a4e0199ec923db256f45a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511281687e241078a4e0199ec923db256f45a 2023-03-14 10:55:02,841 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-14 10:55:02,841 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 10:55:02,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:02,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:02,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:02,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:02,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:02,843 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:02,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 902 msec 2023-03-14 10:55:02,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-14 10:55:02,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:55:03,175 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/.tmp/family1/abbbe2d1453e420183c3c62ec6bef253 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/abbbe2d1453e420183c3c62ec6bef253 2023-03-14 10:55:03,194 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:03,194 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54faf85c to 127.0.0.1:58692 2023-03-14 10:55:03,194 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:03,194 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:03,195 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c31fad to 127.0.0.1:58692 2023-03-14 10:55:03,195 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:03,195 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10545512 to 127.0.0.1:58692 2023-03-14 10:55:03,195 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:03,196 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:03,196 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11047664 to 127.0.0.1:58692 2023-03-14 10:55:03,196 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:03,196 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:03,196 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dfddebe to 127.0.0.1:58692 2023-03-14 10:55:03,196 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:03,200 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 639896e65719e698ba00c8e74c2bb4e8/family1 of 639896e65719e698ba00c8e74c2bb4e8 into abbbe2d1453e420183c3c62ec6bef253(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:03,200 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:03,200 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., storeName=639896e65719e698ba00c8e74c2bb4e8/family1, priority=13, startTime=1678791301925; duration=1sec 2023-03-14 10:55:03,200 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:03,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_] to archive 2023-03-14 10:55:03,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:03,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/e2c2acf73e2a44cc9caf7a4c106d2b4d 2023-03-14 10:55:03,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/b0f5ad40c6ab475581b31a46f0084a05 2023-03-14 10:55:03,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/9821d16a283b4e27961e941c0c8247a0_SeqId_46_ 2023-03-14 10:55:03,311 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-14 10:55:03,312 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 10:55:03,312 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-14 10:55:03,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-14 10:55:03,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE}] 2023-03-14 10:55:03,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE 2023-03-14 10:55:03,317 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:03,317 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791303317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791303317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791303317"}]},"ts":"1678791303317"} 2023-03-14 10:55:03,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:03,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 639896e65719e698ba00c8e74c2bb4e8, disabling compactions & flushes 2023-03-14 10:55:03,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. after waiting 0 ms 2023-03-14 10:55:03,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-14 10:55:03,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:03,477 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 639896e65719e698ba00c8e74c2bb4e8 to self. 2023-03-14 10:55:03,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=CLOSED 2023-03-14 10:55:03,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791303479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791303479"}]},"ts":"1678791303479"} 2023-03-14 10:55:03,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-14 10:55:03,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611 in 163 msec 2023-03-14 10:55:03,482 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=true 2023-03-14 10:55:03,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:03,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791303633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791303633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791303633"}]},"ts":"1678791303633"} 2023-03-14 10:55:03,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:03,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 639896e65719e698ba00c8e74c2bb4e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:55:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,791 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,791 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:03,791 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1 2023-03-14 10:55:03,792 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 639896e65719e698ba00c8e74c2bb4e8 columnFamilyName family1 2023-03-14 10:55:03,797 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/a3734edafc6f4d15ad83efbbc753cb1e_SeqId_52_ 2023-03-14 10:55:03,799 DEBUG [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/family1/abbbe2d1453e420183c3c62ec6bef253 2023-03-14 10:55:03,800 INFO [StoreOpener-639896e65719e698ba00c8e74c2bb4e8-1] regionserver.HStore(310): Store=639896e65719e698ba00c8e74c2bb4e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:03,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:55:03,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 639896e65719e698ba00c8e74c2bb4e8; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66398262, jitterRate=-0.010588794946670532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:55:03,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:55:03,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8., pid=69, masterSystemTime=1678791303786 2023-03-14 10:55:03,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:55:03,808 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=639896e65719e698ba00c8e74c2bb4e8, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:03,808 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678791303808"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791303808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791303808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791303808"}]},"ts":"1678791303808"} 2023-03-14 10:55:03,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-14 10:55:03,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 639896e65719e698ba00c8e74c2bb4e8, server=jenkins-hbase4.apache.org,36455,1678791214611 in 174 msec 2023-03-14 10:55:03,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-14 10:55:03,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=639896e65719e698ba00c8e74c2bb4e8, REOPEN/MOVE in 495 msec 2023-03-14 10:55:03,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-14 10:55:03,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 499 msec 2023-03-14 10:55:03,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-03-14 10:55:03,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-14 10:55:03,818 INFO [Listener at localhost/44023] compactions.TestMobCompactor(278): alter status finished 2023-03-14 10:55:03,819 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 10:55:03,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:03,821 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:03,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:03,821 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791903821 2023-03-14 10:55:03,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:55:03,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 10:55:03,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:03,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x78e851ee to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:03,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@410f2ec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:03,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 10:55:03,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 10:55:03,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:03,830 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 10:55:03,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-03-14 10:55:03,889 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=229 (was 242), OpenFileDescriptor=593 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2784 (was 2809) 2023-03-14 10:55:03,905 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=229, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=169, AvailableMemoryMB=2784 2023-03-14 10:55:03,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 10:55:03,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:03,911 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:55:03,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-14 10:55:03,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:55:03,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 10:55:03,913 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:03,914 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 empty. 2023-03-14 10:55:03,914 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:03,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-14 10:55:03,926 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:03,927 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5259aa7702ef8ef421a5c3e8ba68ca3, NAME => 'testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing d5259aa7702ef8ef421a5c3e8ba68ca3, disabling compactions & flushes 2023-03-14 10:55:03,933 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. after waiting 0 ms 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:03,933 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:03,933 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:03,935 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:55:03,936 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678791303936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791303936"}]},"ts":"1678791303936"} 2023-03-14 10:55:03,937 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:55:03,938 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:55:03,938 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791303938"}]},"ts":"1678791303938"} 2023-03-14 10:55:03,939 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-14 10:55:03,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, ASSIGN}] 2023-03-14 10:55:03,944 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, ASSIGN 2023-03-14 10:55:03,945 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:04,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 10:55:04,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5259aa7702ef8ef421a5c3e8ba68ca3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:04,096 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678791304096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791304096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791304096"}]},"ts":"1678791304096"} 2023-03-14 10:55:04,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure d5259aa7702ef8ef421a5c3e8ba68ca3, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 10:55:04,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:04,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5259aa7702ef8ef421a5c3e8ba68ca3, NAME => 'testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:55:04,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-14 10:55:04,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-14 10:55:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,255 INFO [StoreOpener-d5259aa7702ef8ef421a5c3e8ba68ca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,256 DEBUG [StoreOpener-d5259aa7702ef8ef421a5c3e8ba68ca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1 2023-03-14 10:55:04,256 DEBUG [StoreOpener-d5259aa7702ef8ef421a5c3e8ba68ca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1 2023-03-14 10:55:04,257 INFO [StoreOpener-d5259aa7702ef8ef421a5c3e8ba68ca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5259aa7702ef8ef421a5c3e8ba68ca3 columnFamilyName f1 2023-03-14 10:55:04,258 INFO [StoreOpener-d5259aa7702ef8ef421a5c3e8ba68ca3-1] regionserver.HStore(310): Store=d5259aa7702ef8ef421a5c3e8ba68ca3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:04,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5259aa7702ef8ef421a5c3e8ba68ca3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65574343, jitterRate=-0.0228661447763443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:55:04,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:04,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3., pid=73, masterSystemTime=1678791304249 2023-03-14 10:55:04,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:04,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:04,265 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d5259aa7702ef8ef421a5c3e8ba68ca3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:04,265 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678791304265"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791304265"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791304265"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791304265"}]},"ts":"1678791304265"} 2023-03-14 10:55:04,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-14 10:55:04,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure d5259aa7702ef8ef421a5c3e8ba68ca3, server=jenkins-hbase4.apache.org,36455,1678791214611 in 169 msec 2023-03-14 10:55:04,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-14 10:55:04,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, ASSIGN in 324 msec 2023-03-14 10:55:04,269 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:55:04,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791304269"}]},"ts":"1678791304269"} 2023-03-14 10:55:04,270 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-14 10:55:04,272 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:55:04,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 363 msec 2023-03-14 10:55:04,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 10:55:04,516 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-14 10:55:04,516 DEBUG [Listener at localhost/44023] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-14 10:55:04,517 INFO [Listener at localhost/44023] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-14 10:55:04,520 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-14 10:55:04,521 INFO [Listener at localhost/44023] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-14 10:55:04,521 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-14 10:55:04,525 INFO [Listener at localhost/44023] regionserver.HRegion(2745): Flushing d5259aa7702ef8ef421a5c3e8ba68ca3 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-14 10:55:04,938 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303148d92adf03ac84023b9c6a38909a74136 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303148d92adf03ac84023b9c6a38909a74136 2023-03-14 10:55:05,343 INFO [Listener at localhost/44023] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp/f1/4db07ec6e4fb4a78a893eca0061652cc 2023-03-14 10:55:05,348 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp/f1/4db07ec6e4fb4a78a893eca0061652cc as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc 2023-03-14 10:55:05,352 INFO [Listener at localhost/44023] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc, entries=1, sequenceid=5, filesize=4.9 K 2023-03-14 10:55:05,352 INFO [Listener at localhost/44023] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d5259aa7702ef8ef421a5c3e8ba68ca3 in 827ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:05,353 DEBUG [Listener at localhost/44023] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-14 10:55:05,353 DEBUG [Listener at localhost/44023] regionserver.HRegion(2446): Flush status journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:05,355 INFO [Listener at localhost/44023] regionserver.HRegion(2745): Flushing d5259aa7702ef8ef421a5c3e8ba68ca3 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-14 10:55:05,766 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314483641d1c3e84cb2b3296ada7e81f16b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314483641d1c3e84cb2b3296ada7e81f16b 2023-03-14 10:55:06,171 INFO [Listener at localhost/44023] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp/f1/74efc34070c14b12b109527fcf2d86e8 2023-03-14 10:55:06,175 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp/f1/74efc34070c14b12b109527fcf2d86e8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8 2023-03-14 10:55:06,179 INFO [Listener at localhost/44023] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8, entries=1, sequenceid=9, filesize=4.9 K 2023-03-14 10:55:06,180 INFO [Listener at localhost/44023] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d5259aa7702ef8ef421a5c3e8ba68ca3 in 824ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:06,180 DEBUG [Listener at localhost/44023] regionserver.HRegion(2446): Flush status journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:06,181 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-14 10:55:06,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 10:55:06,183 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 10:55:06,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:06,183 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791906183 2023-03-14 10:55:06,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:55:06,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-14 10:55:06,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-14 10:55:06,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x00c92534 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:06,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38884afc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:06,189 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testGetAfterCompaction' and column='f1' 2023-03-14 10:55:06,232 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,233 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,283 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,283 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,334 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,335 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,385 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,385 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,436 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,437 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,487 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,488 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,538 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,538 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,589 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,589 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,640 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,640 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,691 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,691 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,742 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,742 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,793 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,793 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,844 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,845 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,895 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,895 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,946 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,946 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,997 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:06,997 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,016 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031491c07a5b1b2b4ff891e36b31e69c9c72 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031491c07a5b1b2b4ff891e36b31e69c9c72 2023-03-14 10:55:07,017 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testGetAfterCompaction' column='f1' 2023-03-14 10:55:07,029 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:07,031 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:07,037 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:07,038 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:07,047 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/6d4d033d8e174dc0bc7c2b5cbb47665b first=Optional[r1] last=Optional[r2] 2023-03-14 10:55:07,048 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/6d4d033d8e174dc0bc7c2b5cbb47665b}] 2023-03-14 10:55:07,048 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,049 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/6d4d033d8e174dc0bc7c2b5cbb47665b for inclusion in d5259aa7702ef8ef421a5c3e8ba68ca3/f1 2023-03-14 10:55:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-14 10:55:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:55:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/6d4d033d8e174dc0bc7c2b5cbb47665b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testGetAfterCompaction__mvp1308cvl16t2vkg2ngq6ulmabql1et1d9gj3urb5sh6fgcn053icqpbj8s399b/f1/6d4d033d8e174dc0bc7c2b5cbb47665b 2023-03-14 10:55:07,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testGetAfterCompaction__mvp1308cvl16t2vkg2ngq6ulmabql1et1d9gj3urb5sh6fgcn053icqpbj8s399b/f1/6d4d033d8e174dc0bc7c2b5cbb47665b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_ 2023-03-14 10:55:07,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testGetAfterCompaction__mvp1308cvl16t2vkg2ngq6ulmabql1et1d9gj3urb5sh6fgcn053icqpbj8s399b/f1/6d4d033d8e174dc0bc7c2b5cbb47665b into d5259aa7702ef8ef421a5c3e8ba68ca3/f1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_ - updating store file list. 2023-03-14 10:55:07,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_ into d5259aa7702ef8ef421a5c3e8ba68ca3/f1 2023-03-14 10:55:07,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testGetAfterCompaction__mvp1308cvl16t2vkg2ngq6ulmabql1et1d9gj3urb5sh6fgcn053icqpbj8s399b/f1/6d4d033d8e174dc0bc7c2b5cbb47665b into d5259aa7702ef8ef421a5c3e8ba68ca3/f1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_) 2023-03-14 10:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testGetAfterCompaction__mvp1308cvl16t2vkg2ngq6ulmabql1et1d9gj3urb5sh6fgcn053icqpbj8s399b/f1/6d4d033d8e174dc0bc7c2b5cbb47665b 2023-03-14 10:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): d5259aa7702ef8ef421a5c3e8ba68ca3/f1 is initiating minor compaction 2023-03-14 10:55:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6bb09b3a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:07,062 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d5259aa7702ef8ef421a5c3e8ba68ca3/f1 in testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:07,062 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp, totalSize=10.0 K 2023-03-14 10:55:07,062 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 74efc34070c14b12b109527fcf2d86e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:55:07,062 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:55:07,064 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testGetAfterCompaction' column='f1' 2023-03-14 10:55:07,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:07,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314483641d1c3e84cb2b3296ada7e81f16b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314483641d1c3e84cb2b3296ada7e81f16b 2023-03-14 10:55:07,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303148d92adf03ac84023b9c6a38909a74136 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303148d92adf03ac84023b9c6a38909a74136 2023-03-14 10:55:07,068 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-14 10:55:07,068 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 10:55:07,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testGetAfterCompaction' and column='f1' 2023-03-14 10:55:07,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-14 10:55:07,069 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): d5259aa7702ef8ef421a5c3e8ba68ca3#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:07,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:55:07,075 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 10:55:07,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 894 msec 2023-03-14 10:55:07,099 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,100 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,100 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,103 DEBUG [Listener at localhost/44023] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 10:55:07,107 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 10:55:07,107 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36455] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:07,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-14 10:55:07,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-14 10:55:07,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36455] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-14 10:55:07,108 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36455] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. because compaction request was cancelled 2023-03-14 10:55:07,125 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:55:07,159 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,159 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,159 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,210 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,211 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,211 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,262 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,262 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,262 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,313 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,313 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,313 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,364 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,364 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,364 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,415 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,415 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,416 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,466 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,467 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,467 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,518 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,518 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,518 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,569 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,569 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,569 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,620 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,620 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,620 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,671 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,671 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,672 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,723 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,723 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,723 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,774 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,774 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,774 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,825 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,825 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,825 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,876 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,876 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,876 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,888 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/.tmp/f1/0665404917cb4b5db48be1efb9e3e431 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/0665404917cb4b5db48be1efb9e3e431 2023-03-14 10:55:07,892 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in d5259aa7702ef8ef421a5c3e8ba68ca3/f1 of d5259aa7702ef8ef421a5c3e8ba68ca3 into 0665404917cb4b5db48be1efb9e3e431(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:07,892 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:07,892 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678791307062; duration=0sec 2023-03-14 10:55:07,892 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:07,927 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/0665404917cb4b5db48be1efb9e3e431; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678791307883; access_time=1678791307067; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,927 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,928 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791306170; access_time=1678791305356; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,928 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678791307012; access_time=1678791306199; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 10:55:07,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_] to archive 2023-03-14 10:55:07,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:07,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/74efc34070c14b12b109527fcf2d86e8 2023-03-14 10:55:07,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/ce0a2dc8e3a449e3b20e25a87532e9a1_SeqId_12_ 2023-03-14 10:55:07,978 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/0665404917cb4b5db48be1efb9e3e431; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678791307883; access_time=1678791307067; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:07,979 INFO [Listener at localhost/44023] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678791305343; access_time=1678791304528; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 10:55:08,095 INFO [Listener at localhost/44023] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-14 10:55:08,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-14 10:55:08,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,108 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791308108"}]},"ts":"1678791308108"} 2023-03-14 10:55:08,110 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-14 10:55:08,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 10:55:08,114 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-14 10:55:08,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, UNASSIGN}] 2023-03-14 10:55:08,116 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, UNASSIGN 2023-03-14 10:55:08,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d5259aa7702ef8ef421a5c3e8ba68ca3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:08,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678791308117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791308117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791308117"}]},"ts":"1678791308117"} 2023-03-14 10:55:08,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure d5259aa7702ef8ef421a5c3e8ba68ca3, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:08,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 10:55:08,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5259aa7702ef8ef421a5c3e8ba68ca3, disabling compactions & flushes 2023-03-14 10:55:08,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. after waiting 0 ms 2023-03-14 10:55:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:08,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-14 10:55:08,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-14 10:55:08,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3. 2023-03-14 10:55:08,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5259aa7702ef8ef421a5c3e8ba68ca3: 2023-03-14 10:55:08,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:08,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d5259aa7702ef8ef421a5c3e8ba68ca3, regionState=CLOSED 2023-03-14 10:55:08,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678791308278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791308278"}]},"ts":"1678791308278"} 2023-03-14 10:55:08,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-14 10:55:08,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure d5259aa7702ef8ef421a5c3e8ba68ca3, server=jenkins-hbase4.apache.org,36455,1678791214611 in 161 msec 2023-03-14 10:55:08,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-14 10:55:08,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d5259aa7702ef8ef421a5c3e8ba68ca3, UNASSIGN in 165 msec 2023-03-14 10:55:08,282 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791308282"}]},"ts":"1678791308282"} 2023-03-14 10:55:08,283 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-14 10:55:08,285 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-14 10:55:08,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 185 msec 2023-03-14 10:55:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 10:55:08,412 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-14 10:55:08,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-14 10:55:08,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,429 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,430 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-14 10:55:08,433 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:08,435 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1, FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/recovered.edits] 2023-03-14 10:55:08,438 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/0665404917cb4b5db48be1efb9e3e431 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/0665404917cb4b5db48be1efb9e3e431 2023-03-14 10:55:08,439 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/f1/4db07ec6e4fb4a78a893eca0061652cc 2023-03-14 10:55:08,441 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/recovered.edits/15.seqid to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3/recovered.edits/15.seqid 2023-03-14 10:55:08,441 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testGetAfterCompaction/d5259aa7702ef8ef421a5c3e8ba68ca3 2023-03-14 10:55:08,441 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-14 10:55:08,442 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-14 10:55:08,442 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-14 10:55:08,445 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031491c07a5b1b2b4ff891e36b31e69c9c72 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031491c07a5b1b2b4ff891e36b31e69c9c72 2023-03-14 10:55:08,445 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-14 10:55:08,447 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,468 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-14 10:55:08,470 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-14 10:55:08,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-14 10:55:08,472 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678791308472"}]},"ts":"9223372036854775807"} 2023-03-14 10:55:08,473 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-14 10:55:08,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5259aa7702ef8ef421a5c3e8ba68ca3, NAME => 'testGetAfterCompaction,,1678791303908.d5259aa7702ef8ef421a5c3e8ba68ca3.', STARTKEY => '', ENDKEY => ''}] 2023-03-14 10:55:08,473 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-14 10:55:08,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678791308473"}]},"ts":"9223372036854775807"} 2023-03-14 10:55:08,475 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-14 10:55:08,476 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 10:55:08,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 56 msec 2023-03-14 10:55:08,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-14 10:55:08,533 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-14 10:55:08,545 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238 (was 229) - Thread LEAK? -, OpenFileDescriptor=599 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=212 (was 221), ProcessCount=169 (was 169), AvailableMemoryMB=2782 (was 2784) 2023-03-14 10:55:08,556 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=238, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=212, ProcessCount=169, AvailableMemoryMB=2781 2023-03-14 10:55:08,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 10:55:08,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-14 10:55:08,560 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:55:08,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-14 10:55:08,561 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:55:08,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:08,563 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:08,563 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:08,563 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:08,563 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac empty. 2023-03-14 10:55:08,563 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 empty. 2023-03-14 10:55:08,564 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:08,564 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc empty. 2023-03-14 10:55:08,564 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:08,564 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:08,564 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-14 10:55:08,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:08,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:08,976 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:08,978 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => f7fb312194ae80d3a49902c6111928fc, NAME => 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:08,978 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => d2d7726cca3a4702b5284f4d4c6730ac, NAME => 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:08,978 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => cb7afecf284eff99764fb7f04b890587, NAME => 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing d2d7726cca3a4702b5284f4d4c6730ac, disabling compactions & flushes 2023-03-14 10:55:08,984 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. after waiting 0 ms 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:08,984 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:08,984 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing f7fb312194ae80d3a49902c6111928fc, disabling compactions & flushes 2023-03-14 10:55:08,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. after waiting 0 ms 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:08,987 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:08,987 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:09,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing cb7afecf284eff99764fb7f04b890587, disabling compactions & flushes 2023-03-14 10:55:09,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. after waiting 0 ms 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:09,387 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:55:09,388 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791309388"}]},"ts":"1678791309388"} 2023-03-14 10:55:09,388 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791309388"}]},"ts":"1678791309388"} 2023-03-14 10:55:09,388 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791309388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791309388"}]},"ts":"1678791309388"} 2023-03-14 10:55:09,390 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 10:55:09,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:55:09,391 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791309391"}]},"ts":"1678791309391"} 2023-03-14 10:55:09,392 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-14 10:55:09,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN}] 2023-03-14 10:55:09,398 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN 2023-03-14 10:55:09,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN 2023-03-14 10:55:09,398 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN 2023-03-14 10:55:09,398 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:09,399 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:09,399 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:09,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,551 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,551 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791309550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791309550"}]},"ts":"1678791309550"} 2023-03-14 10:55:09,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791309550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791309550"}]},"ts":"1678791309550"} 2023-03-14 10:55:09,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791309550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791309550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791309550"}]},"ts":"1678791309550"} 2023-03-14 10:55:09,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:09,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:09,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:09,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:09,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb7afecf284eff99764fb7f04b890587, NAME => 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 10:55:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:09,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,710 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,711 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:09,711 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:09,711 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7afecf284eff99764fb7f04b890587 columnFamilyName family1 2023-03-14 10:55:09,712 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(310): Store=cb7afecf284eff99764fb7f04b890587/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,713 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,714 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2 2023-03-14 10:55:09,714 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2 2023-03-14 10:55:09,714 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7afecf284eff99764fb7f04b890587 columnFamilyName family2 2023-03-14 10:55:09,715 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(310): Store=cb7afecf284eff99764fb7f04b890587/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:09,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:09,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:09,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb7afecf284eff99764fb7f04b890587; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67730798, jitterRate=0.009267538785934448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:09,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:09,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., pid=85, masterSystemTime=1678791309705 2023-03-14 10:55:09,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:09,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:09,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7fb312194ae80d3a49902c6111928fc, NAME => 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 10:55:09,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791309724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791309724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791309724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791309724"}]},"ts":"1678791309724"} 2023-03-14 10:55:09,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:09,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,726 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-03-14 10:55:09,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611 in 173 msec 2023-03-14 10:55:09,727 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:09,727 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:09,728 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fb312194ae80d3a49902c6111928fc columnFamilyName family1 2023-03-14 10:55:09,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN in 332 msec 2023-03-14 10:55:09,729 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(310): Store=f7fb312194ae80d3a49902c6111928fc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,729 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,730 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2 2023-03-14 10:55:09,730 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2 2023-03-14 10:55:09,730 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fb312194ae80d3a49902c6111928fc columnFamilyName family2 2023-03-14 10:55:09,731 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(310): Store=f7fb312194ae80d3a49902c6111928fc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:09,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:09,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:09,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7fb312194ae80d3a49902c6111928fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71586368, jitterRate=0.06672000885009766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:09,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:09,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., pid=84, masterSystemTime=1678791309705 2023-03-14 10:55:09,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:09,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:09,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:09,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2d7726cca3a4702b5284f4d4c6730ac, NAME => 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 10:55:09,739 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:09,739 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791309738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791309738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791309738"}]},"ts":"1678791309738"} 2023-03-14 10:55:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,740 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,741 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:09,741 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:09,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-14 10:55:09,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611 in 187 msec 2023-03-14 10:55:09,741 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d7726cca3a4702b5284f4d4c6730ac columnFamilyName family1 2023-03-14 10:55:09,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN in 345 msec 2023-03-14 10:55:09,742 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(310): Store=d2d7726cca3a4702b5284f4d4c6730ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,743 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,744 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2 2023-03-14 10:55:09,744 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2 2023-03-14 10:55:09,744 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d7726cca3a4702b5284f4d4c6730ac columnFamilyName family2 2023-03-14 10:55:09,745 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(310): Store=d2d7726cca3a4702b5284f4d4c6730ac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:09,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:09,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:09,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:09,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2d7726cca3a4702b5284f4d4c6730ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73109352, jitterRate=0.08941423892974854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:09,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:09,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., pid=83, masterSystemTime=1678791309705 2023-03-14 10:55:09,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:09,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:09,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:09,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791309752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791309752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791309752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791309752"}]},"ts":"1678791309752"} 2023-03-14 10:55:09,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-03-14 10:55:09,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611 in 201 msec 2023-03-14 10:55:09,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-03-14 10:55:09,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN in 359 msec 2023-03-14 10:55:09,755 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:55:09,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791309755"}]},"ts":"1678791309755"} 2023-03-14 10:55:09,757 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-14 10:55:09,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:55:09,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2010 sec 2023-03-14 10:55:10,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 10:55:10,667 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-14 10:55:10,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:10,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:10,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:10,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:10,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 10:55:10,680 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 10:55:10,681 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:10,681 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 10:55:10,681 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 10:55:10,681 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:10,681 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:10,682 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:10,683 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:10,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:10,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:10,683 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:10,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:10,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 10:55:10,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 10:55:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 10:55:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:10,684 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 10:55:10,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:10,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:10,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:10,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:10,687 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:10,687 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:10,688 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb7afecf284eff99764fb7f04b890587 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:10,688 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:10,689 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:10,689 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f7fb312194ae80d3a49902c6111928fc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:10,690 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2d7726cca3a4702b5284f4d4c6730ac 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:11,106 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 2023-03-14 10:55:11,106 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 2023-03-14 10:55:11,106 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f 2023-03-14 10:55:11,112 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/61ae0da297db4b42b042fbe5c72473bd 2023-03-14 10:55:11,512 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/62b4607632214fc783e7d3b3bba529c0 2023-03-14 10:55:11,513 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/b6e6c873cc00451295d9944109c3b3d9 2023-03-14 10:55:11,524 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365 2023-03-14 10:55:11,893 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-14 10:55:11,928 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777 2023-03-14 10:55:11,928 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8 2023-03-14 10:55:11,929 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/e14b82b5521448d6ba06c140e1fec2bd 2023-03-14 10:55:11,934 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/61ae0da297db4b42b042fbe5c72473bd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd 2023-03-14 10:55:11,936 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/0ec865f7ea0d4e819c39c242dea30e7a 2023-03-14 10:55:11,938 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:11,939 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/e14b82b5521448d6ba06c140e1fec2bd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd 2023-03-14 10:55:11,940 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/b6e6c873cc00451295d9944109c3b3d9 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9 2023-03-14 10:55:11,942 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:11,943 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f7fb312194ae80d3a49902c6111928fc in 1254ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:11,944 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:11,944 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:11,944 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:11,944 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:11,945 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/0ec865f7ea0d4e819c39c242dea30e7a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a 2023-03-14 10:55:11,949 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:11,950 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d2d7726cca3a4702b5284f4d4c6730ac in 1260ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:11,950 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:11,950 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:11,950 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:12,336 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/b06750685d954c0080ad6ab322bd5401 2023-03-14 10:55:12,340 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/62b4607632214fc783e7d3b3bba529c0 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0 2023-03-14 10:55:12,344 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:12,345 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/b06750685d954c0080ad6ab322bd5401 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401 2023-03-14 10:55:12,349 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:12,350 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cb7afecf284eff99764fb7f04b890587 in 1662ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:12,350 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:12,350 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 10:55:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 10:55:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,352 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 10:55:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65f1044d[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:12,354 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 10:55:12,354 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,355 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,355 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 10:55:12,355 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 10:55:12,355 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,355 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:12,355 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 10:55:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:12,357 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 10:55:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:12,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 10:55:12,359 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 10:55:12,359 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:12,359 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:12,359 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 10:55:12,359 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:12,361 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,361 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:12,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,361 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:12,362 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,363 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:12,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 10:55:12,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:12,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 10:55:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:12,365 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:12,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:12,366 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:12,365 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:12,366 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,366 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:12,366 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,466 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:12,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:12,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:12,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:12,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:12,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:12,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 10:55:12,473 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 10:55:12,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:12,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 10:55:12,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 10:55:12,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,473 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:12,474 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:12,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:12,474 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:12,474 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 10:55:12,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 10:55:12,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 10:55:12,475 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 10:55:12,475 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:12,475 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:12,476 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb7afecf284eff99764fb7f04b890587 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:12,476 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:12,476 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2d7726cca3a4702b5284f4d4c6730ac 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:12,476 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f7fb312194ae80d3a49902c6111928fc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:12,890 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 2023-03-14 10:55:12,890 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb 2023-03-14 10:55:12,890 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 2023-03-14 10:55:13,300 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/27b629d3b4e7446faa676c5739111f1a 2023-03-14 10:55:13,300 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/175487d8c8874d6d8b7cab77532f07a7 2023-03-14 10:55:13,300 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/a76de1328f0f4a12ba4596d9a63ec0dc 2023-03-14 10:55:13,321 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580 2023-03-14 10:55:13,321 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6 2023-03-14 10:55:13,717 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1 2023-03-14 10:55:13,726 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/a921b65a97334b558be3614a58dea701 2023-03-14 10:55:13,726 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/c166696f34fe40ee9ae291f76ea55bd7 2023-03-14 10:55:13,730 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/175487d8c8874d6d8b7cab77532f07a7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7 2023-03-14 10:55:13,730 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/27b629d3b4e7446faa676c5739111f1a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a 2023-03-14 10:55:13,734 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:13,734 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:13,735 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/c166696f34fe40ee9ae291f76ea55bd7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7 2023-03-14 10:55:13,735 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/a921b65a97334b558be3614a58dea701 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701 2023-03-14 10:55:13,738 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:13,738 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:13,739 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d2d7726cca3a4702b5284f4d4c6730ac in 1263ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:13,739 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:13,739 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:13,739 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:13,739 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f7fb312194ae80d3a49902c6111928fc in 1263ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:13,739 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:13,739 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:13,739 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:13,777 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:55:14,122 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/386f5e6275e6430ab106d91b0d3734a5 2023-03-14 10:55:14,126 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/a76de1328f0f4a12ba4596d9a63ec0dc as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc 2023-03-14 10:55:14,130 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:14,130 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/386f5e6275e6430ab106d91b0d3734a5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5 2023-03-14 10:55:14,134 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:14,134 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cb7afecf284eff99764fb7f04b890587 in 1658ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:14,135 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:14,135 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:14,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:14,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:14,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 10:55:14,135 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 10:55:14,136 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,136 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:14,136 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,137 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:14,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 10:55:14,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1849bdd4[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:14,138 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 10:55:14,138 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,140 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 10:55:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 10:55:14,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:14,140 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,140 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:14,141 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 10:55:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:14,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 10:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 10:55:14,143 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 10:55:14,143 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:14,143 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:14,143 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 10:55:14,144 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:14,145 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,145 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:14,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,145 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:14,145 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:14,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,146 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,148 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,148 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:14,148 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:14,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:14,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:14,148 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:14,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 10:55:14,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 10:55:14,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:14,148 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:14,148 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:14,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:14,149 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,249 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:14,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:14,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:14,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:14,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:14,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:14,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:14,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 10:55:14,256 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 10:55:14,256 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:14,256 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 10:55:14,256 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 10:55:14,257 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,257 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:14,259 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,259 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:14,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:14,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:14,259 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:14,259 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:14,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:14,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 10:55:14,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 10:55:14,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 10:55:14,261 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 10:55:14,261 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:14,261 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 10:55:14,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:14,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:14,261 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb7afecf284eff99764fb7f04b890587 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:14,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:14,261 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:14,261 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f7fb312194ae80d3a49902c6111928fc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:14,261 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:14,262 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:14,262 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:14,262 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:14,262 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2d7726cca3a4702b5284f4d4c6730ac 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:14,689 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab 2023-03-14 10:55:14,689 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa 2023-03-14 10:55:14,696 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 2023-03-14 10:55:14,697 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/edda383416ac445ebc9d66704dba54c1 2023-03-14 10:55:14,698 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/645628f2598042adaeb0912789ee393b 2023-03-14 10:55:15,103 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 2023-03-14 10:55:15,124 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad 2023-03-14 10:55:15,124 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619 2023-03-14 10:55:15,516 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09 2023-03-14 10:55:15,529 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/eeec672e24dc48f1be6466ea05db27ce 2023-03-14 10:55:15,529 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/f3ec8b5d20af49d7a70c5a54c726e0ed 2023-03-14 10:55:15,536 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/645628f2598042adaeb0912789ee393b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b 2023-03-14 10:55:15,536 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/edda383416ac445ebc9d66704dba54c1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1 2023-03-14 10:55:15,540 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:15,540 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:15,541 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/f3ec8b5d20af49d7a70c5a54c726e0ed as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed 2023-03-14 10:55:15,541 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/eeec672e24dc48f1be6466ea05db27ce as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce 2023-03-14 10:55:15,545 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:15,546 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:15,546 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f7fb312194ae80d3a49902c6111928fc in 1285ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:15,546 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cb7afecf284eff99764fb7f04b890587 in 1285ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:15,546 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:15,547 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:15,547 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:15,547 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:15,547 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:15,547 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:15,921 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/8887c588e4c14af58f584383788c768c 2023-03-14 10:55:15,926 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 2023-03-14 10:55:15,929 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:15,930 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/8887c588e4c14af58f584383788c768c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c 2023-03-14 10:55:15,935 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:15,936 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d2d7726cca3a4702b5284f4d4c6730ac in 1674ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:15,936 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:15,936 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:15,936 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:15,936 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:15,936 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,936 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 10:55:15,936 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 10:55:15,938 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,938 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:15,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:15,938 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,938 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:15,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:15,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:15,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 10:55:15,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45a0ee04[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:15,939 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 10:55:15,939 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,941 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 10:55:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 10:55:15,941 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,941 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 10:55:15,946 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,946 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:15,947 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:15,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:15,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 10:55:15,949 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 10:55:15,949 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:15,949 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:15,949 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 10:55:15,949 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:15,950 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,950 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:15,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,951 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:15,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:15,951 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,952 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,954 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,954 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:15,954 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:15,954 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:15,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:15,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 10:55:15,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 10:55:15,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:15,955 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:15,955 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:16,055 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:16,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:16,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:16,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:16,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 10:55:16,066 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 10:55:16,066 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:16,066 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 10:55:16,066 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 10:55:16,066 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:16,066 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:16,069 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:16,069 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:16,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:16,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:16,069 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:16,069 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:16,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:16,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:16,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 10:55:16,070 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 10:55:16,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 10:55:16,070 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 10:55:16,070 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:16,071 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:16,071 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:16,071 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:16,071 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2d7726cca3a4702b5284f4d4c6730ac 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:16,071 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:16,071 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb7afecf284eff99764fb7f04b890587 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:16,071 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f7fb312194ae80d3a49902c6111928fc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:16,508 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 2023-03-14 10:55:16,509 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 2023-03-14 10:55:16,509 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f 2023-03-14 10:55:16,525 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/62679c98ada0493e8e26fd3614c13ebd 2023-03-14 10:55:16,919 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/801722f46eb34f8a8b9d04c9d245f550 2023-03-14 10:55:16,924 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/6fc17dbb153044f7814ed26980128d91 2023-03-14 10:55:16,933 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7 2023-03-14 10:55:16,944 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa 2023-03-14 10:55:16,947 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/5e3aceeaaf0c444193e6442d549e1488 2023-03-14 10:55:16,952 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/801722f46eb34f8a8b9d04c9d245f550 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550 2023-03-14 10:55:16,956 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/1321832785d941b4b41b75bb70855b3c 2023-03-14 10:55:16,957 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:16,958 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/5e3aceeaaf0c444193e6442d549e1488 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488 2023-03-14 10:55:16,961 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/62679c98ada0493e8e26fd3614c13ebd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd 2023-03-14 10:55:16,963 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:16,964 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f7fb312194ae80d3a49902c6111928fc in 893ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:16,964 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:16,964 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:16,964 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:16,965 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:16,966 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/1321832785d941b4b41b75bb70855b3c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c 2023-03-14 10:55:16,971 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:16,972 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d2d7726cca3a4702b5284f4d4c6730ac in 901ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:16,972 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:16,972 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:16,972 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:17,347 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c 2023-03-14 10:55:17,752 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/8ee088f7407d4d08918cc8a07a9a614e 2023-03-14 10:55:17,756 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/6fc17dbb153044f7814ed26980128d91 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91 2023-03-14 10:55:17,760 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:17,761 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/8ee088f7407d4d08918cc8a07a9a614e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e 2023-03-14 10:55:17,765 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:17,766 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cb7afecf284eff99764fb7f04b890587 in 1695ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:17,766 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:17,766 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:17,766 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:17,766 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:17,767 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,767 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 10:55:17,767 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 10:55:17,768 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:17,768 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:17,769 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,769 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:17,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 10:55:17,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51cbe544[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:17,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 10:55:17,770 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,771 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,772 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 10:55:17,772 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 10:55:17,772 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:17,772 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,772 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:17,774 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 10:55:17,774 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:17,774 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,774 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 10:55:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:17,777 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 10:55:17,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:17,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 10:55:17,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:17,777 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 10:55:17,777 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:17,778 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,778 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,778 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:17,779 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:17,780 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:17,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:17,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:17,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:17,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 10:55:17,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:17,782 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:17,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:17,782 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 10:55:17,783 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,783 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:17,783 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:17,783 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:17,783 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:17,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:17,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:17,883 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:17,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:17,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:17,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678791317895 (current time:1678791317895). 2023-03-14 10:55:17,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-14 10:55:17,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] zookeeper.ReadOnlyZKClient(139): Connect 0x052cbc54 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:17,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a8fda35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:17,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:17,909 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:17,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x052cbc54 to 127.0.0.1:58692 2023-03-14 10:55:17,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:17,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-14 10:55:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:17,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:17,922 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:17,923 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678791917923 2023-03-14 10:55:17,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:17,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678791317884 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-14 10:55:17,925 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:17,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 10:55:17,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-03-14 10:55:17,927 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 10:55:17,928 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678791917928 2023-03-14 10:55:17,930 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:17,930 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-14 10:55:17,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678791317884 2023-03-14 10:55:17,936 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678791317884' 2023-03-14 10:55:17,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-14 10:55:17,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678791317884' starting 'acquire' 2023-03-14 10:55:17,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678791317884', kicking off acquire phase on members. 2023-03-14 10:55:17,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:17,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678791317884 2023-03-14 10:55:17,938 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-14 10:55:17,938 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-14 10:55:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 10:55:17,938 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,938 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678791317884 2023-03-14 10:55:17,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-14 10:55:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678791317884 2023-03-14 10:55:17,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678791317884 from table testCompactionWithHFileLink type FLUSH 2023-03-14 10:55:17,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678791317884 2023-03-14 10:55:17,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678791317884' with timeout 300000ms 2023-03-14 10:55:17,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-14 10:55:17,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678791317884' starting 'acquire' stage 2023-03-14 10:55:17,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678791317884' locally acquired 2023-03-14 10:55:17,941 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (snaptb-1678791317884) in zk 2023-03-14 10:55:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,943 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 10:55:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,943 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678791317884' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'snaptb-1678791317884' on coordinator 2023-03-14 10:55:17,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cf5505c[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:17,944 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678791317884' starting 'in-barrier' execution. 2023-03-14 10:55:17,944 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,946 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:17,946 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678791317884' received 'reached' from coordinator. 2023-03-14 10:55:17,946 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:17,946 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:17,947 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:17,947 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:17,947 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:17,948 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.' region-info for snapshot=snaptb-1678791317884 2023-03-14 10:55:17,948 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.' region-info for snapshot=snaptb-1678791317884 2023-03-14 10:55:17,948 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.' region-info for snapshot=snaptb-1678791317884 2023-03-14 10:55:17,953 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 10:55:17,953 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 10:55:17,953 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 10:55:17,956 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550] hfiles 2023-03-14 10:55:17,956 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91] hfiles 2023-03-14 10:55:17,956 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd for snapshot=snaptb-1678791317884 2023-03-14 10:55:17,956 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd] hfiles 2023-03-14 10:55:17,956 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0 for snapshot=snaptb-1678791317884 2023-03-14 10:55:17,957 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,119 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:18,119 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-14 10:55:18,121 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:18,121 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00c92534 to 127.0.0.1:58692 2023-03-14 10:55:18,121 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:18,121 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78e851ee to 127.0.0.1:58692 2023-03-14 10:55:18,121 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:18,123 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,123 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,123 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,123 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,123 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488] hfiles 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c] hfiles 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e] hfiles 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5 for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,124 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,125 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:18,125 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. completed. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. completed. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. completed. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:18,139 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:18,139 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-14 10:55:18,139 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-14 10:55:18,139 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-14 10:55:18,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-14 10:55:18,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678791317884' locally completed 2023-03-14 10:55:18,140 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678791317884' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:18,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678791317884' has notified controller of completion 2023-03-14 10:55:18,141 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:18,141 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678791317884' completed. 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:18,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:18,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678791317884' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:18,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'snaptb-1678791317884', counting down latch. Waiting for 0 more 2023-03-14 10:55:18,144 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678791317884' execution completed 2023-03-14 10:55:18,144 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:18,144 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:18,144 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678791317884 2023-03-14 10:55:18,144 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678791317884including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-14 10:55:18,145 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,145 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:18,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,146 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 10:55:18,146 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:18,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:18,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:18,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:18,147 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:18,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678791317884 2023-03-14 10:55:18,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-14 10:55:18,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1678791317884 because node does not exist (not an error) 2023-03-14 10:55:18,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678791317884 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-14 10:55:18,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 10:55:18,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678791317884 2023-03-14 10:55:18,150 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:18,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678791317884 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678791317884 2023-03-14 10:55:18,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-14 10:55:18,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-14 10:55:18,150 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678791317884/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:18,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 10:55:18,151 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:18,151 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678791317884 2023-03-14 10:55:18,151 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678791317884 2023-03-14 10:55:18,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979] mob files 2023-03-14 10:55:18,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 2023-03-14 10:55:18,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09] mob files 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6 2023-03-14 10:55:18,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09 2023-03-14 10:55:18,326 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:18,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:18,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:18,327 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-14 10:55:18,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678791317884 2023-03-14 10:55:18,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/snaptb-1678791317884 2023-03-14 10:55:18,627 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:18,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:18,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:18,628 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-14 10:55:19,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/snaptb-1678791317884 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/snaptb-1678791317884 2023-03-14 10:55:19,128 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:19,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:19,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:19,130 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-14 10:55:19,825 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678791317884 of table testCompactionWithHFileLink completed 2023-03-14 10:55:19,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/snaptb-1678791317884 2023-03-14 10:55:19,826 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/snaptb-1678791317884 2023-03-14 10:55:19,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678791317884 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678791317924Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678791318561 (+637 ms)Consolidate snapshot: snaptb-1678791317884 at 1678791318561Loading Region manifests for snaptb-1678791317884 at 1678791318561Writing data manifest for snaptb-1678791317884 at 1678791318572 (+11 ms)Verifying snapshot: snaptb-1678791317884 at 1678791318979 (+407 ms)Snapshot snaptb-1678791317884 of table testCompactionWithHFileLink completed at 1678791319825 (+846 ms) 2023-03-14 10:55:19,827 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 10:55:19,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.9020 sec 2023-03-14 10:55:20,130 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:20,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:20,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-14 10:55:20,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 10:55:20,160 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 10:55:20,160 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:20,160 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 10:55:20,160 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 10:55:20,161 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:20,161 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:20,162 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:20,162 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:20,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:20,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:20,162 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:20,162 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:20,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:20,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:20,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:20,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 10:55:20,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 10:55:20,163 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 10:55:20,163 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:20,163 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 10:55:20,164 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:20,164 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. started... 2023-03-14 10:55:20,164 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb7afecf284eff99764fb7f04b890587 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:20,164 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:20,164 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. started... 2023-03-14 10:55:20,164 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f7fb312194ae80d3a49902c6111928fc 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:20,168 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:20,168 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:20,168 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:20,168 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. started... 2023-03-14 10:55:20,168 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d2d7726cca3a4702b5284f4d4c6730ac 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:20,589 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/19129ec50b164ddf81a2c6eb321bc381 2023-03-14 10:55:20,593 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19129ec50b164ddf81a2c6eb321bc381 2023-03-14 10:55:20,989 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/49892b0296d34ea6bc9cd20210cb3d72 2023-03-14 10:55:20,989 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/6501fa3db4cf4bbc9048c4777ee26027 2023-03-14 10:55:20,993 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6501fa3db4cf4bbc9048c4777ee26027 2023-03-14 10:55:20,993 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49892b0296d34ea6bc9cd20210cb3d72 2023-03-14 10:55:21,006 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/607277666a2d4406868b8e2fde3fae53 2023-03-14 10:55:21,010 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/7564f2afd22f4daa8f09aa83bc619ae0 2023-03-14 10:55:21,010 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 607277666a2d4406868b8e2fde3fae53 2023-03-14 10:55:21,011 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/ed8529f5d7c949f39d47800618b10c86 2023-03-14 10:55:21,011 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/19129ec50b164ddf81a2c6eb321bc381 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381 2023-03-14 10:55:21,017 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7564f2afd22f4daa8f09aa83bc619ae0 2023-03-14 10:55:21,017 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/49892b0296d34ea6bc9cd20210cb3d72 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72 2023-03-14 10:55:21,018 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed8529f5d7c949f39d47800618b10c86 2023-03-14 10:55:21,019 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/6501fa3db4cf4bbc9048c4777ee26027 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027 2023-03-14 10:55:21,019 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19129ec50b164ddf81a2c6eb321bc381 2023-03-14 10:55:21,019 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,021 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/607277666a2d4406868b8e2fde3fae53 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53 2023-03-14 10:55:21,023 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49892b0296d34ea6bc9cd20210cb3d72 2023-03-14 10:55:21,023 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,024 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/7564f2afd22f4daa8f09aa83bc619ae0 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0 2023-03-14 10:55:21,025 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6501fa3db4cf4bbc9048c4777ee26027 2023-03-14 10:55:21,025 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,025 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 607277666a2d4406868b8e2fde3fae53 2023-03-14 10:55:21,025 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,025 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/ed8529f5d7c949f39d47800618b10c86 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86 2023-03-14 10:55:21,026 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cb7afecf284eff99764fb7f04b890587 in 862ms, sequenceid=24, compaction requested=true 2023-03-14 10:55:21,026 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:21,026 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:21,026 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:21,033 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7564f2afd22f4daa8f09aa83bc619ae0 2023-03-14 10:55:21,033 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,033 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed8529f5d7c949f39d47800618b10c86 2023-03-14 10:55:21,033 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 10:55:21,034 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d2d7726cca3a4702b5284f4d4c6730ac in 866ms, sequenceid=24, compaction requested=true 2023-03-14 10:55:21,034 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f7fb312194ae80d3a49902c6111928fc in 870ms, sequenceid=24, compaction requested=true 2023-03-14 10:55:21,034 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:21,034 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:21,034 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:21,034 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 10:55:21,034 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 10:55:21,036 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,036 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:21,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:21,036 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,036 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:21,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:21,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:21,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:21,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 10:55:21,037 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 10:55:21,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6907fd0b[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:21,037 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,042 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 10:55:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 10:55:21,042 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,042 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:21,044 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,044 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:21,044 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:21,044 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:21,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 10:55:21,046 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 10:55:21,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:21,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:21,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 10:55:21,046 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:21,048 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,048 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:21,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,048 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:21,048 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:21,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,049 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 10:55:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:21,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:21,053 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:21,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 10:55:21,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 10:55:21,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:21,053 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:21,154 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:21,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:21,155 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:21,155 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): cb7afecf284eff99764fb7f04b890587/family1 is initiating major compaction (all files) 2023-03-14 10:55:21,156 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:21,156 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:21,156 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of cb7afecf284eff99764fb7f04b890587/family1 in testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:21,156 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp, totalSize=26.7 K 2023-03-14 10:55:21,156 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 62b4607632214fc783e7d3b3bba529c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310675 2023-03-14 10:55:21,157 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a76de1328f0f4a12ba4596d9a63ec0dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:21,157 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 645628f2598042adaeb0912789ee393b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:21,157 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 6fc17dbb153044f7814ed26980128d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:21,158 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 19129ec50b164ddf81a2c6eb321bc381, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:21,173 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): cb7afecf284eff99764fb7f04b890587#family1#compaction#108 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:21,582 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del 2023-03-14 10:55:21,582 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del 2023-03-14 10:55:22,402 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4554dee013f49fdbc1da28075ec48f5 2023-03-14 10:55:22,403 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/e4554dee013f49fdbc1da28075ec48f5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/e4554dee013f49fdbc1da28075ec48f5 2023-03-14 10:55:22,406 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4554dee013f49fdbc1da28075ec48f5 2023-03-14 10:55:22,407 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb7afecf284eff99764fb7f04b890587/family1 of cb7afecf284eff99764fb7f04b890587 into e4554dee013f49fdbc1da28075ec48f5(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:22,407 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:22,407 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:22,407 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): cb7afecf284eff99764fb7f04b890587/family2 is initiating major compaction (all files) 2023-03-14 10:55:22,407 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:22,407 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:22,408 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of cb7afecf284eff99764fb7f04b890587/family2 in testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:22,408 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp, totalSize=25.4 K 2023-03-14 10:55:22,408 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting b06750685d954c0080ad6ab322bd5401, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310675 2023-03-14 10:55:22,408 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 386f5e6275e6430ab106d91b0d3734a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:22,408 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting f3ec8b5d20af49d7a70c5a54c726e0ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:22,409 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 8ee088f7407d4d08918cc8a07a9a614e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:22,409 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 607277666a2d4406868b8e2fde3fae53, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:22,419 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): cb7afecf284eff99764fb7f04b890587#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:22,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381] to archive 2023-03-14 10:55:22,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:22,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/62b4607632214fc783e7d3b3bba529c0 2023-03-14 10:55:22,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/a76de1328f0f4a12ba4596d9a63ec0dc 2023-03-14 10:55:22,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/645628f2598042adaeb0912789ee393b 2023-03-14 10:55:22,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/6fc17dbb153044f7814ed26980128d91 2023-03-14 10:55:22,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/19129ec50b164ddf81a2c6eb321bc381 2023-03-14 10:55:22,829 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del 2023-03-14 10:55:22,829 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del 2023-03-14 10:55:23,642 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d100a58ec554c179a48370780f8264b 2023-03-14 10:55:23,643 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/5d100a58ec554c179a48370780f8264b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/5d100a58ec554c179a48370780f8264b 2023-03-14 10:55:23,646 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d100a58ec554c179a48370780f8264b 2023-03-14 10:55:23,647 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb7afecf284eff99764fb7f04b890587/family2 of cb7afecf284eff99764fb7f04b890587 into 5d100a58ec554c179a48370780f8264b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:23,647 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:23,647 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:23,647 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): f7fb312194ae80d3a49902c6111928fc/family1 is initiating major compaction (all files) 2023-03-14 10:55:23,647 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:23,647 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:23,648 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of f7fb312194ae80d3a49902c6111928fc/family1 in testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:23,648 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp, totalSize=26.7 K 2023-03-14 10:55:23,649 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 61ae0da297db4b42b042fbe5c72473bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310676 2023-03-14 10:55:23,649 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 175487d8c8874d6d8b7cab77532f07a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:23,649 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting edda383416ac445ebc9d66704dba54c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:23,649 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 801722f46eb34f8a8b9d04c9d245f550, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:23,650 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 6501fa3db4cf4bbc9048c4777ee26027, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:23,659 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): f7fb312194ae80d3a49902c6111928fc#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:23,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53] to archive 2023-03-14 10:55:23,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:23,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/b06750685d954c0080ad6ab322bd5401 2023-03-14 10:55:23,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/386f5e6275e6430ab106d91b0d3734a5 2023-03-14 10:55:23,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/f3ec8b5d20af49d7a70c5a54c726e0ed 2023-03-14 10:55:23,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/8ee088f7407d4d08918cc8a07a9a614e 2023-03-14 10:55:23,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/607277666a2d4406868b8e2fde3fae53 2023-03-14 10:55:24,077 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del 2023-03-14 10:55:24,078 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del 2023-03-14 10:55:24,892 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ce357c32eb4a9a9f341be2db9d8a54 2023-03-14 10:55:24,892 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/a1ce357c32eb4a9a9f341be2db9d8a54 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/a1ce357c32eb4a9a9f341be2db9d8a54 2023-03-14 10:55:24,896 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ce357c32eb4a9a9f341be2db9d8a54 2023-03-14 10:55:24,897 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f7fb312194ae80d3a49902c6111928fc/family1 of f7fb312194ae80d3a49902c6111928fc into a1ce357c32eb4a9a9f341be2db9d8a54(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:24,897 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:24,897 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:24,897 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): f7fb312194ae80d3a49902c6111928fc/family2 is initiating major compaction (all files) 2023-03-14 10:55:24,898 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:24,898 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:24,898 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of f7fb312194ae80d3a49902c6111928fc/family2 in testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:24,898 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp, totalSize=25.4 K 2023-03-14 10:55:24,898 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting e14b82b5521448d6ba06c140e1fec2bd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310676 2023-03-14 10:55:24,899 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a921b65a97334b558be3614a58dea701, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:24,899 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting eeec672e24dc48f1be6466ea05db27ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:24,900 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 5e3aceeaaf0c444193e6442d549e1488, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:24,900 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting ed8529f5d7c949f39d47800618b10c86, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:24,915 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): f7fb312194ae80d3a49902c6111928fc#family2#compaction#111 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:24,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027] to archive 2023-03-14 10:55:24,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:24,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/61ae0da297db4b42b042fbe5c72473bd 2023-03-14 10:55:24,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/175487d8c8874d6d8b7cab77532f07a7 2023-03-14 10:55:24,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/edda383416ac445ebc9d66704dba54c1 2023-03-14 10:55:24,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/801722f46eb34f8a8b9d04c9d245f550 2023-03-14 10:55:24,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/6501fa3db4cf4bbc9048c4777ee26027 2023-03-14 10:55:25,323 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del 2023-03-14 10:55:25,323 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del 2023-03-14 10:55:26,137 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e1cc062a2354a1986a9cc1a032c792d 2023-03-14 10:55:26,139 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/8e1cc062a2354a1986a9cc1a032c792d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/8e1cc062a2354a1986a9cc1a032c792d 2023-03-14 10:55:26,142 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e1cc062a2354a1986a9cc1a032c792d 2023-03-14 10:55:26,143 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f7fb312194ae80d3a49902c6111928fc/family2 of f7fb312194ae80d3a49902c6111928fc into 8e1cc062a2354a1986a9cc1a032c792d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:26,143 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:26,144 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:26,144 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): d2d7726cca3a4702b5284f4d4c6730ac/family1 is initiating major compaction (all files) 2023-03-14 10:55:26,144 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:26,144 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:26,144 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of d2d7726cca3a4702b5284f4d4c6730ac/family1 in testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:26,144 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp, totalSize=26.7 K 2023-03-14 10:55:26,144 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting b6e6c873cc00451295d9944109c3b3d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310674 2023-03-14 10:55:26,145 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 27b629d3b4e7446faa676c5739111f1a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:26,145 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting f2e9ead3bd8345b7be1fdc8cb84b8c85, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314251 2023-03-14 10:55:26,145 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 62679c98ada0493e8e26fd3614c13ebd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:26,146 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 49892b0296d34ea6bc9cd20210cb3d72, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:26,157 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): d2d7726cca3a4702b5284f4d4c6730ac#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:26,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86] to archive 2023-03-14 10:55:26,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:26,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/e14b82b5521448d6ba06c140e1fec2bd 2023-03-14 10:55:26,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/a921b65a97334b558be3614a58dea701 2023-03-14 10:55:26,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/eeec672e24dc48f1be6466ea05db27ce 2023-03-14 10:55:26,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/5e3aceeaaf0c444193e6442d549e1488 2023-03-14 10:55:26,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/ed8529f5d7c949f39d47800618b10c86 2023-03-14 10:55:26,565 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del 2023-03-14 10:55:26,565 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del 2023-03-14 10:55:27,380 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 978d95f72e4949b3972130eddecf94c9 2023-03-14 10:55:27,380 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/978d95f72e4949b3972130eddecf94c9 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/978d95f72e4949b3972130eddecf94c9 2023-03-14 10:55:27,384 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 978d95f72e4949b3972130eddecf94c9 2023-03-14 10:55:27,385 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2d7726cca3a4702b5284f4d4c6730ac/family1 of d2d7726cca3a4702b5284f4d4c6730ac into 978d95f72e4949b3972130eddecf94c9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:27,385 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:27,385 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:27,385 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): d2d7726cca3a4702b5284f4d4c6730ac/family2 is initiating major compaction (all files) 2023-03-14 10:55:27,385 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:27,385 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:27,386 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of d2d7726cca3a4702b5284f4d4c6730ac/family2 in testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:27,386 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp, totalSize=25.4 K 2023-03-14 10:55:27,386 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 0ec865f7ea0d4e819c39c242dea30e7a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310674 2023-03-14 10:55:27,386 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c166696f34fe40ee9ae291f76ea55bd7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:27,387 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 8887c588e4c14af58f584383788c768c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314251 2023-03-14 10:55:27,387 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 1321832785d941b4b41b75bb70855b3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:27,388 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 7564f2afd22f4daa8f09aa83bc619ae0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 10:55:27,403 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): d2d7726cca3a4702b5284f4d4c6730ac#family2#compaction#113 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:27,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72] to archive 2023-03-14 10:55:27,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:27,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/b6e6c873cc00451295d9944109c3b3d9 2023-03-14 10:55:27,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/27b629d3b4e7446faa676c5739111f1a 2023-03-14 10:55:27,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/f2e9ead3bd8345b7be1fdc8cb84b8c85 2023-03-14 10:55:27,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/62679c98ada0493e8e26fd3614c13ebd 2023-03-14 10:55:27,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/49892b0296d34ea6bc9cd20210cb3d72 2023-03-14 10:55:27,816 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del 2023-03-14 10:55:27,816 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del 2023-03-14 10:55:28,631 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ec2c6670c5e4899869e0a2aace3d457 2023-03-14 10:55:28,632 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/4ec2c6670c5e4899869e0a2aace3d457 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/4ec2c6670c5e4899869e0a2aace3d457 2023-03-14 10:55:28,635 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ec2c6670c5e4899869e0a2aace3d457 2023-03-14 10:55:28,636 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2d7726cca3a4702b5284f4d4c6730ac/family2 of d2d7726cca3a4702b5284f4d4c6730ac into 4ec2c6670c5e4899869e0a2aace3d457(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:28,636 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:28,642 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:28,646 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:28,651 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:28,652 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:28,660 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:55:28,694 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-14 10:55:28,697 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del 2023-03-14 10:55:28,700 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del 2023-03-14 10:55:28,703 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del 2023-03-14 10:55:28,703 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:28,703 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(139): Connect 0x7c526350 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:28,709 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20eae3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:28,710 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:28,710 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:28,710 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:28,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0] to archive 2023-03-14 10:55:28,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:28,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/0ec865f7ea0d4e819c39c242dea30e7a 2023-03-14 10:55:28,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/c166696f34fe40ee9ae291f76ea55bd7 2023-03-14 10:55:28,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/8887c588e4c14af58f584383788c768c 2023-03-14 10:55:28,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/1321832785d941b4b41b75bb70855b3c 2023-03-14 10:55:28,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/7564f2afd22f4daa8f09aa83bc619ae0 2023-03-14 10:55:29,177 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916 2023-03-14 10:55:29,178 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,198 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:29,202 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:29,209 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:29,211 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:29,220 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/34ea6d75f3e543079c9ec882f6d8b6af first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-14 10:55:29,220 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/34ea6d75f3e543079c9ec882f6d8b6af}] 2023-03-14 10:55:29,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/34ea6d75f3e543079c9ec882f6d8b6af for inclusion in d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-14 10:55:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 10:55:29,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:29,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/34ea6d75f3e543079c9ec882f6d8b6af to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__5nhd9ukvj3slsrtn9ve2aibb6c7an4cubcblukdhohh4dhefml0dolfscdgluv6r/family1/34ea6d75f3e543079c9ec882f6d8b6af 2023-03-14 10:55:29,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__5nhd9ukvj3slsrtn9ve2aibb6c7an4cubcblukdhohh4dhefml0dolfscdgluv6r/family1/34ea6d75f3e543079c9ec882f6d8b6af as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ 2023-03-14 10:55:29,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__5nhd9ukvj3slsrtn9ve2aibb6c7an4cubcblukdhohh4dhefml0dolfscdgluv6r/family1/34ea6d75f3e543079c9ec882f6d8b6af into d2d7726cca3a4702b5284f4d4c6730ac/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ - updating store file list. 2023-03-14 10:55:29,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ into d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:29,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__5nhd9ukvj3slsrtn9ve2aibb6c7an4cubcblukdhohh4dhefml0dolfscdgluv6r/family1/34ea6d75f3e543079c9ec882f6d8b6af into d2d7726cca3a4702b5284f4d4c6730ac/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_) 2023-03-14 10:55:29,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__5nhd9ukvj3slsrtn9ve2aibb6c7an4cubcblukdhohh4dhefml0dolfscdgluv6r/family1/34ea6d75f3e543079c9ec882f6d8b6af 2023-03-14 10:55:29,234 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,235 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,236 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 2023-03-14 10:55:29,237 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 2023-03-14 10:55:29,238 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 2023-03-14 10:55:29,240 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 2023-03-14 10:55:29,240 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:29,240 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 10:55:29,241 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:29,573 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1 2023-03-14 10:55:29,574 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,575 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562 2023-03-14 10:55:29,576 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/3576ed2736a84d288415d0e82c6f9606 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-14 10:55:29,601 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/19d1fe50a1f94f7b90b59b6142712649 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-14 10:55:29,603 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/3576ed2736a84d288415d0e82c6f9606}] 2023-03-14 10:55:29,603 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/19d1fe50a1f94f7b90b59b6142712649}] 2023-03-14 10:55:29,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/19d1fe50a1f94f7b90b59b6142712649 for inclusion in cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:29,605 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/3576ed2736a84d288415d0e82c6f9606 for inclusion in f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-14 10:55:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 10:55:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-14 10:55:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 10:55:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/19d1fe50a1f94f7b90b59b6142712649 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__sfkkhi43bt4gsm5ebjqcvncb2eftu2dapa3ufk8g9tu9nk79ff05baf61fr8674r/family1/19d1fe50a1f94f7b90b59b6142712649 2023-03-14 10:55:29,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/3576ed2736a84d288415d0e82c6f9606 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__r9ucrkt7k4mqkd9teus7e213mcic3hml8g81irevd7c7g2tid9hubj3es2dc29v3/family1/3576ed2736a84d288415d0e82c6f9606 2023-03-14 10:55:29,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__sfkkhi43bt4gsm5ebjqcvncb2eftu2dapa3ufk8g9tu9nk79ff05baf61fr8674r/family1/19d1fe50a1f94f7b90b59b6142712649 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ 2023-03-14 10:55:29,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__r9ucrkt7k4mqkd9teus7e213mcic3hml8g81irevd7c7g2tid9hubj3es2dc29v3/family1/3576ed2736a84d288415d0e82c6f9606 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ 2023-03-14 10:55:29,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__sfkkhi43bt4gsm5ebjqcvncb2eftu2dapa3ufk8g9tu9nk79ff05baf61fr8674r/family1/19d1fe50a1f94f7b90b59b6142712649 into cb7afecf284eff99764fb7f04b890587/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ - updating store file list. 2023-03-14 10:55:29,612 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__r9ucrkt7k4mqkd9teus7e213mcic3hml8g81irevd7c7g2tid9hubj3es2dc29v3/family1/3576ed2736a84d288415d0e82c6f9606 into f7fb312194ae80d3a49902c6111928fc/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ - updating store file list. 2023-03-14 10:55:29,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ into cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:29,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ into f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:29,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__sfkkhi43bt4gsm5ebjqcvncb2eftu2dapa3ufk8g9tu9nk79ff05baf61fr8674r/family1/19d1fe50a1f94f7b90b59b6142712649 into cb7afecf284eff99764fb7f04b890587/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_) 2023-03-14 10:55:29,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__r9ucrkt7k4mqkd9teus7e213mcic3hml8g81irevd7c7g2tid9hubj3es2dc29v3/family1/3576ed2736a84d288415d0e82c6f9606 into f7fb312194ae80d3a49902c6111928fc/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_) 2023-03-14 10:55:29,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__sfkkhi43bt4gsm5ebjqcvncb2eftu2dapa3ufk8g9tu9nk79ff05baf61fr8674r/family1/19d1fe50a1f94f7b90b59b6142712649 2023-03-14 10:55:29,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__r9ucrkt7k4mqkd9teus7e213mcic3hml8g81irevd7c7g2tid9hubj3es2dc29v3/family1/3576ed2736a84d288415d0e82c6f9606 2023-03-14 10:55:29,617 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,617 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,617 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,617 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,618 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab 2023-03-14 10:55:29,618 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 2023-03-14 10:55:29,619 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f 2023-03-14 10:55:29,619 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb 2023-03-14 10:55:29,620 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 2023-03-14 10:55:29,620 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f 2023-03-14 10:55:29,621 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 2023-03-14 10:55:29,621 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:29,621 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 10:55:29,621 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa 2023-03-14 10:55:29,621 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:29,621 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 10:55:29,621 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:29,622 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:29,622 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:29,622 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:29,622 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del] 2023-03-14 10:55:29,622 DEBUG [Listener at localhost/44023] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,623 DEBUG [Listener at localhost/44023] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314af57169cebcc4b21a2f121f99bb622c3_del 2023-03-14 10:55:29,624 INFO [Listener at localhost/44023] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 10:55:29,624 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del] 2023-03-14 10:55:29,624 DEBUG [Listener at localhost/44023] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,625 DEBUG [Listener at localhost/44023] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314549c2b8a80ef4742b9c2a46db5e4daf1_del 2023-03-14 10:55:29,625 INFO [Listener at localhost/44023] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 10:55:29,625 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del] 2023-03-14 10:55:29,626 DEBUG [Listener at localhost/44023] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:29,627 DEBUG [Listener at localhost/44023] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d3bc98391c364c1fa96ab8dcfc496c5d_del 2023-03-14 10:55:29,627 INFO [Listener at localhost/44023] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 10:55:29,629 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:29,631 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:29,634 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:29,635 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:29,641 INFO [Listener at localhost/44023] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-14 10:55:29,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-14 10:55:29,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-14 10:55:29,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 10:55:29,644 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791329644"}]},"ts":"1678791329644"} 2023-03-14 10:55:29,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-14 10:55:29,647 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-14 10:55:29,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, UNASSIGN}] 2023-03-14 10:55:29,648 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, UNASSIGN 2023-03-14 10:55:29,649 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, UNASSIGN 2023-03-14 10:55:29,649 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, UNASSIGN 2023-03-14 10:55:29,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:29,649 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:29,649 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:29,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791329649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791329649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791329649"}]},"ts":"1678791329649"} 2023-03-14 10:55:29,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791329649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791329649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791329649"}]},"ts":"1678791329649"} 2023-03-14 10:55:29,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791329649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791329649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791329649"}]},"ts":"1678791329649"} 2023-03-14 10:55:29,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:29,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:29,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:29,706 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(317): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,36455,1678791214611, timeout=1678791329802, delay=96, operations=[pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611, pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611]] 2023-03-14 10:55:29,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 10:55:29,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:29,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7fb312194ae80d3a49902c6111928fc, disabling compactions & flushes 2023-03-14 10:55:29,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:29,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:29,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. after waiting 0 ms 2023-03-14 10:55:29,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:29,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 10:55:29,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:29,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:29,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:29,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:29,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb7afecf284eff99764fb7f04b890587, disabling compactions & flushes 2023-03-14 10:55:29,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:29,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. after waiting 0 ms 2023-03-14 10:55:29,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:29,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=CLOSED 2023-03-14 10:55:29,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791329810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791329810"}]},"ts":"1678791329810"} 2023-03-14 10:55:29,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-03-14 10:55:29,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611 in 159 msec 2023-03-14 10:55:29,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 10:55:29,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, UNASSIGN in 166 msec 2023-03-14 10:55:29,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:29,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:29,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:29,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:29,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2d7726cca3a4702b5284f4d4c6730ac, disabling compactions & flushes 2023-03-14 10:55:29,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:29,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:29,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. after waiting 0 ms 2023-03-14 10:55:29,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:29,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=CLOSED 2023-03-14 10:55:29,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791329816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791329816"}]},"ts":"1678791329816"} 2023-03-14 10:55:29,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-14 10:55:29,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611 in 166 msec 2023-03-14 10:55:29,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, UNASSIGN in 172 msec 2023-03-14 10:55:29,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 10:55:29,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:29,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:29,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:29,822 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=CLOSED 2023-03-14 10:55:29,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791329822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791329822"}]},"ts":"1678791329822"} 2023-03-14 10:55:29,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-03-14 10:55:29,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611 in 172 msec 2023-03-14 10:55:29,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-03-14 10:55:29,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, UNASSIGN in 178 msec 2023-03-14 10:55:29,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791329827"}]},"ts":"1678791329827"} 2023-03-14 10:55:29,828 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-14 10:55:29,835 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-14 10:55:29,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 194 msec 2023-03-14 10:55:29,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 10:55:29,946 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-14 10:55:29,956 INFO [Listener at localhost/44023] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:29,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:29,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678791329957 (current time:1678791329957). 2023-03-14 10:55:29,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-14 10:55:29,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] zookeeper.ReadOnlyZKClient(139): Connect 0x63428cdb to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:29,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297f8bbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:29,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:29,964 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63428cdb to 127.0.0.1:58692 2023-03-14 10:55:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-14 10:55:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:29,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:29,968 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:29,969 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678791929969 2023-03-14 10:55:29,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:29,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678791317884-1678791329956 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-14 10:55:29,969 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:29,969 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-14 10:55:30,069 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:30,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:30,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:30,070 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-14 10:55:30,271 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:30,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:30,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:30,272 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-14 10:55:30,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 10:55:30,377 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916] hfiles 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/978d95f72e4949b3972130eddecf94c9] hfiles 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/a1ce357c32eb4a9a9f341be2db9d8a54] hfiles 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/e4554dee013f49fdbc1da28075ec48f5] hfiles 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/978d95f72e4949b3972130eddecf94c9 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/e4554dee013f49fdbc1da28075ec48f5 2023-03-14 10:55:30,382 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/a1ce357c32eb4a9a9f341be2db9d8a54 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/4ec2c6670c5e4899869e0a2aace3d457] hfiles 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/4ec2c6670c5e4899869e0a2aace3d457 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/8e1cc062a2354a1986a9cc1a032c792d] hfiles 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/5d100a58ec554c179a48370780f8264b] hfiles 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/8e1cc062a2354a1986a9cc1a032c792d 2023-03-14 10:55:30,383 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/5d100a58ec554c179a48370780f8264b 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09] hfiles 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031445e0805de7814cd09aea7cc0510717d1 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303144670dc59858b44ce9273a50d6bf9a777 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314674aed3fcdd7410492e462fd5fb39619 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314d209a8a48b174d8bae6d491199b2b63c 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031426a4dc9865d54b1ba4c19eab72fc9580 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314afbd881d51bd417dbeab3e590db615ad 2023-03-14 10:55:30,394 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314cfc0efeeb138443f936f58afbb767365 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ef73d3a725ab4fed96043e4c509b24d7 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314156b9b5f01ff4906a99869dad514f0fa 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031426ead68c2a7841f7b7dd64560c0d30f8 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314c0452245a08d4ed38b93450f03dd81a6 2023-03-14 10:55:30,395 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314cf21ea0bc01d4785ac81066d981eef09 2023-03-14 10:55:30,572 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:30,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:30,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:30,573 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-14 10:55:30,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-14 10:55:30,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:30,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:31,074 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:31,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:31,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 10:55:31,075 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-14 10:55:31,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678791317884-1678791329956 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:32,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678791317884-1678791329956 of table testCompactionWithHFileLink completed 2023-03-14 10:55:32,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:32,051 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:32,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678791317884-1678791329956 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678791329969Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678791330375 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678791317884-1678791329956 at 1678791330806 (+431 ms)Loading Region manifests for hbase-failsafe-snaptb-1678791317884-1678791329956 at 1678791330806Writing data manifest for hbase-failsafe-snaptb-1678791317884-1678791329956 at 1678791330809 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1678791317884-1678791329956 at 1678791331219 (+410 ms)Snapshot hbase-failsafe-snaptb-1678791317884-1678791329956 of table testCompactionWithHFileLink completed at 1678791332051 (+832 ms) 2023-03-14 10:55:32,053 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 10:55:32,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0860 sec 2023-03-14 10:55:32,075 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 10:55:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 10:55:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678791317884-1678791329956 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-14 10:55:32,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678791317884" table: "testCompactionWithHFileLink" creation_time: 1678791317895 type: FLUSH version: 2 ttl: 0 ) 2023-03-14 10:55:32,122 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678791317884 as table=testCompactionWithHFileLink 2023-03-14 10:55:32,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 10:55:32,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 10:55:32,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 10:55:32,532 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-14 10:55:32,533 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:32,533 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-14 10:55:32,534 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 10:55:32,538 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678791317884" table: "testCompactionWithHFileLink" creation_time: 1678791317895 type: FLUSH version: 2 ttl: 0 2023-03-14 10:55:32,539 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink 2023-03-14 10:55:32,544 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-14 10:55:32,548 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314d978393e54f447868f40f0aaabdd8562 2023-03-14 10:55:32,550 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303141e1ad170f85540cab24ebb2262cc9ce1 2023-03-14 10:55:32,551 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303143ffdb3bbd2ad4eb19dc842f592ef4916 2023-03-14 10:55:32,551 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,554 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,557 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,560 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,563 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,566 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,569 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,573 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,576 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,579 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,582 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,585 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 of snapshot=snaptb-1678791317884 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 10:55:32,591 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303144e5088f947a647e8881e90dcdfd81246_del 2023-03-14 10:55:32,592 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f76a245cda9d4c4dbf861653cf2a120f_del 2023-03-14 10:55:32,594 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314958d558d5c7a4185ac2abc9e900b5ecb_del 2023-03-14 10:55:32,594 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:32,594 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:32,594 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:32,598 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/90a1c5193fef492684fed239688e650a_SeqId_29_ 2023-03-14 10:55:32,598 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/e4554dee013f49fdbc1da28075ec48f5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/e4554dee013f49fdbc1da28075ec48f5 2023-03-14 10:55:32,598 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/978d95f72e4949b3972130eddecf94c9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/978d95f72e4949b3972130eddecf94c9 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/a1ce357c32eb4a9a9f341be2db9d8a54 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/a1ce357c32eb4a9a9f341be2db9d8a54 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 61ae0da297db4b42b042fbe5c72473bd of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/173d9a94e0d7470ebaecdbdd97358cf6_SeqId_29_ 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/399f5a6105194b799b06d3e393d0e67c_SeqId_29_ 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b6e6c873cc00451295d9944109c3b3d9 of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,600 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 62b4607632214fc783e7d3b3bba529c0 of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,605 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 175487d8c8874d6d8b7cab77532f07a7 of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,605 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27b629d3b4e7446faa676c5739111f1a of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,606 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a76de1328f0f4a12ba4596d9a63ec0dc of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,609 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink edda383416ac445ebc9d66704dba54c1 of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,610 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f2e9ead3bd8345b7be1fdc8cb84b8c85 of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,610 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 645628f2598042adaeb0912789ee393b of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,614 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 62679c98ada0493e8e26fd3614c13ebd of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,615 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 801722f46eb34f8a8b9d04c9d245f550 of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,617 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6fc17dbb153044f7814ed26980128d91 of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,631 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/8e1cc062a2354a1986a9cc1a032c792d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/8e1cc062a2354a1986a9cc1a032c792d 2023-03-14 10:55:32,631 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e14b82b5521448d6ba06c140e1fec2bd of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,632 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/4ec2c6670c5e4899869e0a2aace3d457 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/4ec2c6670c5e4899869e0a2aace3d457 2023-03-14 10:55:32,632 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0ec865f7ea0d4e819c39c242dea30e7a of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,638 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/5d100a58ec554c179a48370780f8264b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/5d100a58ec554c179a48370780f8264b 2023-03-14 10:55:32,638 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b06750685d954c0080ad6ab322bd5401 of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,644 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a921b65a97334b558be3614a58dea701 of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,644 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c166696f34fe40ee9ae291f76ea55bd7 of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,645 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 386f5e6275e6430ab106d91b0d3734a5 of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,648 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eeec672e24dc48f1be6466ea05db27ce of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,648 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8887c588e4c14af58f584383788c768c of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,649 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f3ec8b5d20af49d7a70c5a54c726e0ed of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,652 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5e3aceeaaf0c444193e6442d549e1488 of snapshot=snaptb-1678791317884 to region=f7fb312194ae80d3a49902c6111928fc table=testCompactionWithHFileLink 2023-03-14 10:55:32,652 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1321832785d941b4b41b75bb70855b3c of snapshot=snaptb-1678791317884 to region=d2d7726cca3a4702b5284f4d4c6730ac table=testCompactionWithHFileLink 2023-03-14 10:55:32,652 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8ee088f7407d4d08918cc8a07a9a614e of snapshot=snaptb-1678791317884 to region=cb7afecf284eff99764fb7f04b890587 table=testCompactionWithHFileLink 2023-03-14 10:55:32,656 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678791317884" table: "testCompactionWithHFileLink" creation_time: 1678791317895 type: FLUSH version: 2 ttl: 0 2023-03-14 10:55:32,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678791332658"}]},"ts":"9223372036854775807"} 2023-03-14 10:55:32,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678791332658"}]},"ts":"9223372036854775807"} 2023-03-14 10:55:32,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678791332658"}]},"ts":"9223372036854775807"} 2023-03-14 10:55:32,660 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-14 10:55:32,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cb7afecf284eff99764fb7f04b890587, NAME => 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => d2d7726cca3a4702b5284f4d4c6730ac, NAME => 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f7fb312194ae80d3a49902c6111928fc, NAME => 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.', STARTKEY => '2', ENDKEY => ''}] 2023-03-14 10:55:32,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791332659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791332659"}]},"ts":"1678791332659"} 2023-03-14 10:55:32,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791332659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791332659"}]},"ts":"1678791332659"} 2023-03-14 10:55:32,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791332659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791332659"}]},"ts":"1678791332659"} 2023-03-14 10:55:32,662 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 10:55:32,662 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-14 10:55:32,662 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => cb7afecf284eff99764fb7f04b890587, NAME => 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => d2d7726cca3a4702b5284f4d4c6730ac, NAME => 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f7fb312194ae80d3a49902c6111928fc, NAME => 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.', STARTKEY => '2', ENDKEY => ''}] 2023-03-14 10:55:32,662 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678791317884 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-14 10:55:32,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678791317884" table: "testCompactionWithHFileLink" creation_time: 1678791317895 type: FLUSH version: 2 ttl: 0 ) in 555 msec 2023-03-14 10:55:32,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 10:55:32,729 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-14 10:55:32,729 INFO [Listener at localhost/44023] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:32,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1678791317884-1678791329956" 2023-03-14 10:55:32,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678791317884-1678791329956 2023-03-14 10:55:32,738 INFO [Listener at localhost/44023] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-14 10:55:32,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-14 10:55:32,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-14 10:55:32,750 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-14 10:55:32,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 10:55:32,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791332750"}]},"ts":"1678791332750"} 2023-03-14 10:55:32,751 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-14 10:55:32,753 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-14 10:55:32,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN}] 2023-03-14 10:55:32,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN 2023-03-14 10:55:32,754 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN 2023-03-14 10:55:32,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN 2023-03-14 10:55:32,755 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 10:55:32,755 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 10:55:32,755 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 10:55:32,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 10:55:32,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:32,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:32,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791332907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791332907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791332907"}]},"ts":"1678791332907"} 2023-03-14 10:55:32,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:32,907 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791332907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791332907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791332907"}]},"ts":"1678791332907"} 2023-03-14 10:55:32,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791332907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791332907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791332907"}]},"ts":"1678791332907"} 2023-03-14 10:55:32,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:32,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:32,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:33,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 10:55:33,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:33,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2d7726cca3a4702b5284f4d4c6730ac, NAME => 'testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 10:55:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,064 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,065 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:33,065 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:33,065 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d7726cca3a4702b5284f4d4c6730ac columnFamilyName family1 2023-03-14 10:55:33,076 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a 2023-03-14 10:55:33,081 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd 2023-03-14 10:55:33,085 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9 2023-03-14 10:55:33,090 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85 2023-03-14 10:55:33,090 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(310): Store=d2d7726cca3a4702b5284f4d4c6730ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,090 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,091 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2 2023-03-14 10:55:33,091 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2 2023-03-14 10:55:33,092 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d7726cca3a4702b5284f4d4c6730ac columnFamilyName family2 2023-03-14 10:55:33,098 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a 2023-03-14 10:55:33,103 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c 2023-03-14 10:55:33,107 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c 2023-03-14 10:55:33,113 DEBUG [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7 2023-03-14 10:55:33,113 INFO [StoreOpener-d2d7726cca3a4702b5284f4d4c6730ac-1] regionserver.HStore(310): Store=d2d7726cca3a4702b5284f4d4c6730ac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:33,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:55:33,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2d7726cca3a4702b5284f4d4c6730ac; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59583174, jitterRate=-0.11214151978492737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:33,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:33,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., pid=102, masterSystemTime=1678791333060 2023-03-14 10:55:33,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:33,120 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:55:33,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-14 10:55:33,120 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:33,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:33,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7fb312194ae80d3a49902c6111928fc, NAME => 'testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,123 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d2d7726cca3a4702b5284f4d4c6730ac, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:33,123 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791333123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791333123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791333123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791333123"}]},"ts":"1678791333123"} 2023-03-14 10:55:33,124 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,125 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:55:33,125 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1912): d2d7726cca3a4702b5284f4d4c6730ac/family2 is initiating minor compaction (all files) 2023-03-14 10:55:33,125 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d2d7726cca3a4702b5284f4d4c6730ac/family2 in testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:33,126 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp, totalSize=20.4 K 2023-03-14 10:55:33,126 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:33,126 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:33,126 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:55:33,126 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1912): d2d7726cca3a4702b5284f4d4c6730ac/family1 is initiating minor compaction (all files) 2023-03-14 10:55:33,126 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d2d7726cca3a4702b5284f4d4c6730ac/family1 in testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:55:33,126 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fb312194ae80d3a49902c6111928fc columnFamilyName family1 2023-03-14 10:55:33,127 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp, totalSize=21.6 K 2023-03-14 10:55:33,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-14 10:55:33,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure d2d7726cca3a4702b5284f4d4c6730ac, server=jenkins-hbase4.apache.org,36455,1678791214611 in 216 msec 2023-03-14 10:55:33,128 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310674 2023-03-14 10:55:33,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2d7726cca3a4702b5284f4d4c6730ac, ASSIGN in 374 msec 2023-03-14 10:55:33,129 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310674 2023-03-14 10:55:33,129 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:33,130 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:33,130 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314251 2023-03-14 10:55:33,130 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314251 2023-03-14 10:55:33,131 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:33,131 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:33,146 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7 2023-03-14 10:55:33,157 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd 2023-03-14 10:55:33,166 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550 2023-03-14 10:55:33,175 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] throttle.PressureAwareThroughputController(145): d2d7726cca3a4702b5284f4d4c6730ac#family2#compaction#115 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:33,178 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): d2d7726cca3a4702b5284f4d4c6730ac#family1#compaction#114 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:33,179 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1 2023-03-14 10:55:33,180 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(310): Store=f7fb312194ae80d3a49902c6111928fc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,180 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,181 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2 2023-03-14 10:55:33,181 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2 2023-03-14 10:55:33,181 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7fb312194ae80d3a49902c6111928fc columnFamilyName family2 2023-03-14 10:55:33,195 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488 2023-03-14 10:55:33,206 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701 2023-03-14 10:55:33,211 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd 2023-03-14 10:55:33,218 DEBUG [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce 2023-03-14 10:55:33,218 INFO [StoreOpener-f7fb312194ae80d3a49902c6111928fc-1] regionserver.HStore(310): Store=f7fb312194ae80d3a49902c6111928fc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:33,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:55:33,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7fb312194ae80d3a49902c6111928fc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71788697, jitterRate=0.06973494589328766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:33,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:33,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., pid=101, masterSystemTime=1678791333060 2023-03-14 10:55:33,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-14 10:55:33,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-14 10:55:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:33,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:33,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb7afecf284eff99764fb7f04b890587, NAME => 'testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 10:55:33,225 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f7fb312194ae80d3a49902c6111928fc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,225 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678791333225"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791333225"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791333225"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791333225"}]},"ts":"1678791333225"} 2023-03-14 10:55:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,228 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-03-14 10:55:33,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure f7fb312194ae80d3a49902c6111928fc, server=jenkins-hbase4.apache.org,36455,1678791214611 in 319 msec 2023-03-14 10:55:33,229 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:33,229 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:33,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f7fb312194ae80d3a49902c6111928fc, ASSIGN in 475 msec 2023-03-14 10:55:33,229 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7afecf284eff99764fb7f04b890587 columnFamilyName family1 2023-03-14 10:55:33,238 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0 2023-03-14 10:55:33,246 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b 2023-03-14 10:55:33,252 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91 2023-03-14 10:55:33,258 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc 2023-03-14 10:55:33,258 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(310): Store=cb7afecf284eff99764fb7f04b890587/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,259 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,260 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2 2023-03-14 10:55:33,260 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2 2023-03-14 10:55:33,260 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb7afecf284eff99764fb7f04b890587 columnFamilyName family2 2023-03-14 10:55:33,271 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5 2023-03-14 10:55:33,278 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e 2023-03-14 10:55:33,285 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401 2023-03-14 10:55:33,291 DEBUG [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(539): loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed 2023-03-14 10:55:33,292 INFO [StoreOpener-cb7afecf284eff99764fb7f04b890587-1] regionserver.HStore(310): Store=cb7afecf284eff99764fb7f04b890587/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:33,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:33,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:55:33,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb7afecf284eff99764fb7f04b890587; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59187862, jitterRate=-0.11803212761878967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:33,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:33,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., pid=103, masterSystemTime=1678791333060 2023-03-14 10:55:33,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 10:55:33,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-14 10:55:33,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:33,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:33,300 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=cb7afecf284eff99764fb7f04b890587, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:33,300 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791333299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791333299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791333299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791333299"}]},"ts":"1678791333299"} 2023-03-14 10:55:33,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-14 10:55:33,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure cb7afecf284eff99764fb7f04b890587, server=jenkins-hbase4.apache.org,36455,1678791214611 in 392 msec 2023-03-14 10:55:33,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-03-14 10:55:33,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cb7afecf284eff99764fb7f04b890587, ASSIGN in 549 msec 2023-03-14 10:55:33,304 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791333304"}]},"ts":"1678791333304"} 2023-03-14 10:55:33,305 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-14 10:55:33,308 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-14 10:55:33,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 565 msec 2023-03-14 10:55:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 10:55:33,353 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-14 10:55:33,365 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:33,374 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:33,382 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:33,383 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:33,389 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:55:33,401 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-14 10:55:33,401 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:33,401 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(139): Connect 0x3865866b to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:33,409 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f90ddc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:33,409 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:33,409 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:33,409 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:34,006 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family1/bbeb884c142147e19e50eb16db78cebf as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/bbeb884c142147e19e50eb16db78cebf 2023-03-14 10:55:34,010 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-14 10:55:34,010 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d2d7726cca3a4702b5284f4d4c6730ac/family1 of d2d7726cca3a4702b5284f4d4c6730ac into bbeb884c142147e19e50eb16db78cebf(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:34,010 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:34,010 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., storeName=d2d7726cca3a4702b5284f4d4c6730ac/family1, priority=12, startTime=1678791333119; duration=0sec 2023-03-14 10:55:34,010 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-14 10:55:34,012 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:55:34,014 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:55:34,014 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1912): f7fb312194ae80d3a49902c6111928fc/family1 is initiating minor compaction (all files) 2023-03-14 10:55:34,014 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f7fb312194ae80d3a49902c6111928fc/family1 in testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:34,014 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp, totalSize=21.6 K 2023-03-14 10:55:34,015 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/.tmp/family2/b92e1add35fe4dd3a60968522671240d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/b92e1add35fe4dd3a60968522671240d 2023-03-14 10:55:34,015 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310676 2023-03-14 10:55:34,016 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:34,017 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:34,017 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:34,020 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d2d7726cca3a4702b5284f4d4c6730ac/family2 of d2d7726cca3a4702b5284f4d4c6730ac into b92e1add35fe4dd3a60968522671240d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:34,020 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:34,020 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., storeName=d2d7726cca3a4702b5284f4d4c6730ac/family2, priority=12, startTime=1678791333120; duration=0sec 2023-03-14 10:55:34,021 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 10:55:34,021 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:55:34,023 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:55:34,023 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1912): cb7afecf284eff99764fb7f04b890587/family2 is initiating minor compaction (all files) 2023-03-14 10:55:34,024 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2259): Starting compaction of cb7afecf284eff99764fb7f04b890587/family2 in testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:34,024 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp, totalSize=20.4 K 2023-03-14 10:55:34,025 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310675 2023-03-14 10:55:34,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd] to archive 2023-03-14 10:55:34,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,026 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:34,029 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:34,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-b6e6c873cc00451295d9944109c3b3d9 2023-03-14 10:55:34,030 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:34,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-27b629d3b4e7446faa676c5739111f1a 2023-03-14 10:55:34,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-f2e9ead3bd8345b7be1fdc8cb84b8c85 2023-03-14 10:55:34,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-62679c98ada0493e8e26fd3614c13ebd 2023-03-14 10:55:34,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c] to archive 2023-03-14 10:55:34,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-0ec865f7ea0d4e819c39c242dea30e7a 2023-03-14 10:55:34,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-c166696f34fe40ee9ae291f76ea55bd7 2023-03-14 10:55:34,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-8887c588e4c14af58f584383788c768c 2023-03-14 10:55:34,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family2/testCompactionWithHFileLink=d2d7726cca3a4702b5284f4d4c6730ac-1321832785d941b4b41b75bb70855b3c 2023-03-14 10:55:34,044 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): f7fb312194ae80d3a49902c6111928fc#family1#compaction#116 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:34,046 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] throttle.PressureAwareThroughputController(145): cb7afecf284eff99764fb7f04b890587#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:34,282 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314146722f7ce614b5e88989043e95ae766 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314146722f7ce614b5e88989043e95ae766 2023-03-14 10:55:34,284 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,286 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314f5ef432a4be247cc9787241331e018c6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314f5ef432a4be247cc9787241331e018c6 2023-03-14 10:55:34,286 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314a2fd698e5077462cab6ef94e27c3cb78 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a2fd698e5077462cab6ef94e27c3cb78 2023-03-14 10:55:34,287 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,287 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,298 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:34,302 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:34,311 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:34,318 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:34,341 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/426b7a5e79d94ed28560367de3b072a1 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-14 10:55:34,342 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/3ef172b5bde14cacab65837113a52c62 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-14 10:55:34,342 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/426b7a5e79d94ed28560367de3b072a1}] 2023-03-14 10:55:34,342 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/3ef172b5bde14cacab65837113a52c62}] 2023-03-14 10:55:34,343 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/068404bef00e4cf2bcf03650d3af48fd first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-14 10:55:34,346 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/068404bef00e4cf2bcf03650d3af48fd}] 2023-03-14 10:55:34,350 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/068404bef00e4cf2bcf03650d3af48fd for inclusion in f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:34,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/426b7a5e79d94ed28560367de3b072a1 for inclusion in cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:34,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/3ef172b5bde14cacab65837113a52c62 for inclusion in d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 10:55:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 10:55:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:55:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:34,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:34,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/068404bef00e4cf2bcf03650d3af48fd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__u42qoolqg1r5dqbo9g6dak78rlrhmvoemp4a191rpfaror5t5909qnenihj6u909/family1/068404bef00e4cf2bcf03650d3af48fd 2023-03-14 10:55:34,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/3ef172b5bde14cacab65837113a52c62 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__dbnjciqscg9r2jdstt69u182kpv6b1lq2jsd5vsljm9lll9ij9gpuk77sq9aao8h/family1/3ef172b5bde14cacab65837113a52c62 2023-03-14 10:55:34,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/426b7a5e79d94ed28560367de3b072a1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__as4fgc35rs1qtsglpqde8rvitven5u2ggobq8s2p5a144gcog86hud1b5so3te15/family1/426b7a5e79d94ed28560367de3b072a1 2023-03-14 10:55:34,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__u42qoolqg1r5dqbo9g6dak78rlrhmvoemp4a191rpfaror5t5909qnenihj6u909/family1/068404bef00e4cf2bcf03650d3af48fd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/74d75f8a645946328836fc68d51b07a3_SeqId_34_ 2023-03-14 10:55:34,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__as4fgc35rs1qtsglpqde8rvitven5u2ggobq8s2p5a144gcog86hud1b5so3te15/family1/426b7a5e79d94ed28560367de3b072a1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_ 2023-03-14 10:55:34,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__dbnjciqscg9r2jdstt69u182kpv6b1lq2jsd5vsljm9lll9ij9gpuk77sq9aao8h/family1/3ef172b5bde14cacab65837113a52c62 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/0129fbe532b64dd594c50f08ce51532f_SeqId_36_ 2023-03-14 10:55:34,357 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__u42qoolqg1r5dqbo9g6dak78rlrhmvoemp4a191rpfaror5t5909qnenihj6u909/family1/068404bef00e4cf2bcf03650d3af48fd into f7fb312194ae80d3a49902c6111928fc/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/74d75f8a645946328836fc68d51b07a3_SeqId_34_ - updating store file list. 2023-03-14 10:55:34,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__as4fgc35rs1qtsglpqde8rvitven5u2ggobq8s2p5a144gcog86hud1b5so3te15/family1/426b7a5e79d94ed28560367de3b072a1 into cb7afecf284eff99764fb7f04b890587/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_ - updating store file list. 2023-03-14 10:55:34,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__dbnjciqscg9r2jdstt69u182kpv6b1lq2jsd5vsljm9lll9ij9gpuk77sq9aao8h/family1/3ef172b5bde14cacab65837113a52c62 into d2d7726cca3a4702b5284f4d4c6730ac/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/0129fbe532b64dd594c50f08ce51532f_SeqId_36_ - updating store file list. 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/0129fbe532b64dd594c50f08ce51532f_SeqId_36_ into d2d7726cca3a4702b5284f4d4c6730ac/family1 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__dbnjciqscg9r2jdstt69u182kpv6b1lq2jsd5vsljm9lll9ij9gpuk77sq9aao8h/family1/3ef172b5bde14cacab65837113a52c62 into d2d7726cca3a4702b5284f4d4c6730ac/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/family1/0129fbe532b64dd594c50f08ce51532f_SeqId_36_) 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/74d75f8a645946328836fc68d51b07a3_SeqId_34_ into f7fb312194ae80d3a49902c6111928fc/family1 2023-03-14 10:55:34,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__dbnjciqscg9r2jdstt69u182kpv6b1lq2jsd5vsljm9lll9ij9gpuk77sq9aao8h/family1/3ef172b5bde14cacab65837113a52c62 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__u42qoolqg1r5dqbo9g6dak78rlrhmvoemp4a191rpfaror5t5909qnenihj6u909/family1/068404bef00e4cf2bcf03650d3af48fd into f7fb312194ae80d3a49902c6111928fc/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/74d75f8a645946328836fc68d51b07a3_SeqId_34_) 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_ into cb7afecf284eff99764fb7f04b890587/family1 2023-03-14 10:55:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__as4fgc35rs1qtsglpqde8rvitven5u2ggobq8s2p5a144gcog86hud1b5so3te15/family1/426b7a5e79d94ed28560367de3b072a1 into cb7afecf284eff99764fb7f04b890587/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_) 2023-03-14 10:55:34,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__u42qoolqg1r5dqbo9g6dak78rlrhmvoemp4a191rpfaror5t5909qnenihj6u909/family1/068404bef00e4cf2bcf03650d3af48fd 2023-03-14 10:55:34,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testCompactionWithHFileLink__as4fgc35rs1qtsglpqde8rvitven5u2ggobq8s2p5a144gcog86hud1b5so3te15/family1/426b7a5e79d94ed28560367de3b072a1 2023-03-14 10:55:34,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:34,364 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,365 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,365 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,366 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-14 10:55:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): cb7afecf284eff99764fb7f04b890587/family1 is initiating minor compaction (all files) 2023-03-14 10:55:34,367 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303143804408c652e4d55bb4fd8e4257cd601 2023-03-14 10:55:34,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2521e1b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 10:55:34,367 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314375f211e17694c63901e3fa3fd9c18b8 2023-03-14 10:55:34,368 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303148d5809b71a9540e8920bea2d89c1b937 2023-03-14 10:55:34,368 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,368 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303146bda6a3cbb494035a6e018210e0b0bbb 2023-03-14 10:55:34,369 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303149e985ada639547c6a91855286a5ec5a8 2023-03-14 10:55:34,369 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,370 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314992b2a636f254f28964180f988b5999f 2023-03-14 10:55:34,370 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230314d757de36db1a471d900a37bf58232979 2023-03-14 10:55:34,370 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:34,370 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 10:55:34,371 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031420e496d98f3642129029813f235e3fab 2023-03-14 10:55:34,371 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:34,371 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314bc1ff935625342eb8c686461879e5bfa 2023-03-14 10:55:34,371 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:34,371 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 10:55:34,371 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314297941cb8f1a45d382172dc176ced00f 2023-03-14 10:55:34,371 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:34,372 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303148dad7b7b336a46efa716b855eb8f7db6 2023-03-14 10:55:34,373 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314f87d60a8a35c4f4abf1889ff90875843 2023-03-14 10:55:34,373 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 10:55:34,373 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 10:55:34,373 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 10:55:34,373 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 10:55:34,379 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:34,381 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:34,384 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:34,385 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:34,391 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:34,392 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:34,408 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=282 (was 238) - Thread LEAK? -, OpenFileDescriptor=749 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 212), ProcessCount=169 (was 169), AvailableMemoryMB=2685 (was 2781) 2023-03-14 10:55:34,420 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=282, OpenFileDescriptor=749, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=169, AvailableMemoryMB=2684 2023-03-14 10:55:34,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-14 10:55:34,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-14 10:55:34,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-14 10:55:34,432 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 10:55:34,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-14 10:55:34,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-14 10:55:34,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 10:55:34,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-14 10:55:34,535 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:55:34,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-14 10:55:34,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:55:34,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da empty. 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99 empty. 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155 empty. 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:34,538 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:34,539 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:34,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-14 10:55:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:34,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:34,873 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family1/9f5ff3bd140a4409a72ce2a6a6bb14ee as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/9f5ff3bd140a4409a72ce2a6a6bb14ee 2023-03-14 10:55:34,877 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f7fb312194ae80d3a49902c6111928fc/family1 of f7fb312194ae80d3a49902c6111928fc into 9f5ff3bd140a4409a72ce2a6a6bb14ee(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:34,877 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:34,877 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., storeName=f7fb312194ae80d3a49902c6111928fc/family1, priority=12, startTime=1678791333224; duration=0sec 2023-03-14 10:55:34,877 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 10:55:34,877 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb7afecf284eff99764fb7f04b890587/family1 in testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:55:34,877 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp, totalSize=28.9 K 2023-03-14 10:55:34,878 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310675 2023-03-14 10:55:34,878 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:34,879 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:34,880 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:34,880 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678791310675 2023-03-14 10:55:34,892 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb7afecf284eff99764fb7f04b890587#family1#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:34,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550] to archive 2023-03-14 10:55:34,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:34,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-61ae0da297db4b42b042fbe5c72473bd 2023-03-14 10:55:34,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-175487d8c8874d6d8b7cab77532f07a7 2023-03-14 10:55:34,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-edda383416ac445ebc9d66704dba54c1 2023-03-14 10:55:34,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family1/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-801722f46eb34f8a8b9d04c9d245f550 2023-03-14 10:55:34,945 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:34,946 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => fde00c7405357fc882bfdd228054e155, NAME => 'ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:34,947 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 092db5a7b358fa9c4c7ac039923503da, NAME => 'ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:34,947 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => bd77aa6bd2a692fa7c5691f440172e99, NAME => 'ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:34,952 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:34,952 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 092db5a7b358fa9c4c7ac039923503da, disabling compactions & flushes 2023-03-14 10:55:34,952 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:34,953 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:34,953 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. after waiting 0 ms 2023-03-14 10:55:34,953 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:34,953 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:34,953 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:35,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:35,267 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family2/edf9397306514b5f83398c1dcce51bab as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/edf9397306514b5f83398c1dcce51bab 2023-03-14 10:55:35,272 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in cb7afecf284eff99764fb7f04b890587/family2 of cb7afecf284eff99764fb7f04b890587 into edf9397306514b5f83398c1dcce51bab(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:35,272 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., storeName=cb7afecf284eff99764fb7f04b890587/family2, priority=12, startTime=1678791333298; duration=1sec 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. because compaction request was cancelled 2023-03-14 10:55:35,272 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:55:35,275 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:55:35,275 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1912): f7fb312194ae80d3a49902c6111928fc/family2 is initiating minor compaction (all files) 2023-03-14 10:55:35,275 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f7fb312194ae80d3a49902c6111928fc/family2 in testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:55:35,275 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp, totalSize=20.4 K 2023-03-14 10:55:35,275 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791310676 2023-03-14 10:55:35,276 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791312468 2023-03-14 10:55:35,277 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791314252 2023-03-14 10:55:35,277 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791316058 2023-03-14 10:55:35,289 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] throttle.PressureAwareThroughputController(145): f7fb312194ae80d3a49902c6111928fc#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:35,308 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/.tmp/family1/1ea25c0c45e045428fdbf8cd7889fbc7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/1ea25c0c45e045428fdbf8cd7889fbc7 2023-03-14 10:55:35,312 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in cb7afecf284eff99764fb7f04b890587/family1 of cb7afecf284eff99764fb7f04b890587 into 1ea25c0c45e045428fdbf8cd7889fbc7(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:55:35,312 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:55:35,312 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678791334366; duration=0sec 2023-03-14 10:55:35,312 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:35,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_] to archive 2023-03-14 10:55:35,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:35,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-62b4607632214fc783e7d3b3bba529c0 2023-03-14 10:55:35,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-a76de1328f0f4a12ba4596d9a63ec0dc 2023-03-14 10:55:35,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-645628f2598042adaeb0912789ee393b 2023-03-14 10:55:35,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-6fc17dbb153044f7814ed26980128d91 2023-03-14 10:55:35,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family1/2731eca0a27b49c0b77f31f9eefa4250_SeqId_34_ 2023-03-14 10:55:35,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e] to archive 2023-03-14 10:55:35,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:35,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-b06750685d954c0080ad6ab322bd5401 2023-03-14 10:55:35,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-386f5e6275e6430ab106d91b0d3734a5 2023-03-14 10:55:35,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-f3ec8b5d20af49d7a70c5a54c726e0ed 2023-03-14 10:55:35,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/family2/testCompactionWithHFileLink=cb7afecf284eff99764fb7f04b890587-8ee088f7407d4d08918cc8a07a9a614e 2023-03-14 10:55:35,340 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing fde00c7405357fc882bfdd228054e155, disabling compactions & flushes 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:35,352 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing bd77aa6bd2a692fa7c5691f440172e99, disabling compactions & flushes 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,352 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,352 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. after waiting 0 ms 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. after waiting 0 ms 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,353 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,353 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:35,353 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:35,355 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:55:35,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791335355"}]},"ts":"1678791335355"} 2023-03-14 10:55:35,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678791335355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791335355"}]},"ts":"1678791335355"} 2023-03-14 10:55:35,356 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791335355"}]},"ts":"1678791335355"} 2023-03-14 10:55:35,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 10:55:35,358 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:55:35,358 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791335358"}]},"ts":"1678791335358"} 2023-03-14 10:55:35,359 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-14 10:55:35,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=092db5a7b358fa9c4c7ac039923503da, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bd77aa6bd2a692fa7c5691f440172e99, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fde00c7405357fc882bfdd228054e155, ASSIGN}] 2023-03-14 10:55:35,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=092db5a7b358fa9c4c7ac039923503da, ASSIGN 2023-03-14 10:55:35,365 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bd77aa6bd2a692fa7c5691f440172e99, ASSIGN 2023-03-14 10:55:35,365 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fde00c7405357fc882bfdd228054e155, ASSIGN 2023-03-14 10:55:35,365 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=092db5a7b358fa9c4c7ac039923503da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:35,365 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bd77aa6bd2a692fa7c5691f440172e99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:35,366 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fde00c7405357fc882bfdd228054e155, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:35,518 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bd77aa6bd2a692fa7c5691f440172e99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,518 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=092db5a7b358fa9c4c7ac039923503da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=fde00c7405357fc882bfdd228054e155, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,518 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678791335518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791335518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791335518"}]},"ts":"1678791335518"} 2023-03-14 10:55:35,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791335518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791335518"}]},"ts":"1678791335518"} 2023-03-14 10:55:35,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791335518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791335518"}]},"ts":"1678791335518"} 2023-03-14 10:55:35,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure bd77aa6bd2a692fa7c5691f440172e99, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:35,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 092db5a7b358fa9c4c7ac039923503da, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:35,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure fde00c7405357fc882bfdd228054e155, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:35,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fde00c7405357fc882bfdd228054e155, NAME => 'ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 10:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,675 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,676 DEBUG [StoreOpener-fde00c7405357fc882bfdd228054e155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1 2023-03-14 10:55:35,676 DEBUG [StoreOpener-fde00c7405357fc882bfdd228054e155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1 2023-03-14 10:55:35,677 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde00c7405357fc882bfdd228054e155 columnFamilyName family1 2023-03-14 10:55:35,678 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] regionserver.HStore(310): Store=fde00c7405357fc882bfdd228054e155/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,678 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,679 DEBUG [StoreOpener-fde00c7405357fc882bfdd228054e155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2 2023-03-14 10:55:35,679 DEBUG [StoreOpener-fde00c7405357fc882bfdd228054e155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2 2023-03-14 10:55:35,679 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fde00c7405357fc882bfdd228054e155 columnFamilyName family2 2023-03-14 10:55:35,680 INFO [StoreOpener-fde00c7405357fc882bfdd228054e155-1] regionserver.HStore(310): Store=fde00c7405357fc882bfdd228054e155/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:35,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fde00c7405357fc882bfdd228054e155 2023-03-14 10:55:35,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:35,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fde00c7405357fc882bfdd228054e155; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72853593, jitterRate=0.08560313284397125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:35,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:35,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155., pid=111, masterSystemTime=1678791335671 2023-03-14 10:55:35,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:35,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd77aa6bd2a692fa7c5691f440172e99, NAME => 'ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 10:55:35,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=fde00c7405357fc882bfdd228054e155, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791335688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791335688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791335688"}]},"ts":"1678791335688"} 2023-03-14 10:55:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,689 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,690 DEBUG [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1 2023-03-14 10:55:35,690 DEBUG [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1 2023-03-14 10:55:35,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-03-14 10:55:35,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure fde00c7405357fc882bfdd228054e155, server=jenkins-hbase4.apache.org,36455,1678791214611 in 169 msec 2023-03-14 10:55:35,691 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd77aa6bd2a692fa7c5691f440172e99 columnFamilyName family1 2023-03-14 10:55:35,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fde00c7405357fc882bfdd228054e155, ASSIGN in 327 msec 2023-03-14 10:55:35,691 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] regionserver.HStore(310): Store=bd77aa6bd2a692fa7c5691f440172e99/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,692 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,693 DEBUG [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2 2023-03-14 10:55:35,693 DEBUG [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2 2023-03-14 10:55:35,693 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd77aa6bd2a692fa7c5691f440172e99 columnFamilyName family2 2023-03-14 10:55:35,693 INFO [StoreOpener-bd77aa6bd2a692fa7c5691f440172e99-1] regionserver.HStore(310): Store=bd77aa6bd2a692fa7c5691f440172e99/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:35,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:55:35,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:35,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd77aa6bd2a692fa7c5691f440172e99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58909281, jitterRate=-0.12218330800533295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:35,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:35,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99., pid=109, masterSystemTime=1678791335671 2023-03-14 10:55:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:35,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 092db5a7b358fa9c4c7ac039923503da, NAME => 'ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 10:55:35,701 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bd77aa6bd2a692fa7c5691f440172e99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,701 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678791335701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791335701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791335701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791335701"}]},"ts":"1678791335701"} 2023-03-14 10:55:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,703 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,704 DEBUG [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1 2023-03-14 10:55:35,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-03-14 10:55:35,704 DEBUG [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1 2023-03-14 10:55:35,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure bd77aa6bd2a692fa7c5691f440172e99, server=jenkins-hbase4.apache.org,36455,1678791214611 in 182 msec 2023-03-14 10:55:35,704 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 092db5a7b358fa9c4c7ac039923503da columnFamilyName family1 2023-03-14 10:55:35,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bd77aa6bd2a692fa7c5691f440172e99, ASSIGN in 341 msec 2023-03-14 10:55:35,705 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] regionserver.HStore(310): Store=092db5a7b358fa9c4c7ac039923503da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,705 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,706 DEBUG [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2 2023-03-14 10:55:35,706 DEBUG [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2 2023-03-14 10:55:35,706 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 092db5a7b358fa9c4c7ac039923503da columnFamilyName family2 2023-03-14 10:55:35,707 INFO [StoreOpener-092db5a7b358fa9c4c7ac039923503da-1] regionserver.HStore(310): Store=092db5a7b358fa9c4c7ac039923503da/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:35,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:55:35,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:55:35,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:35,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 092db5a7b358fa9c4c7ac039923503da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70551176, jitterRate=0.05129444599151611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:55:35,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:35,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da., pid=110, masterSystemTime=1678791335671 2023-03-14 10:55:35,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:35,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:35,714 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=092db5a7b358fa9c4c7ac039923503da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:35,714 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678791335714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791335714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791335714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791335714"}]},"ts":"1678791335714"} 2023-03-14 10:55:35,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-03-14 10:55:35,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 092db5a7b358fa9c4c7ac039923503da, server=jenkins-hbase4.apache.org,36455,1678791214611 in 195 msec 2023-03-14 10:55:35,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-03-14 10:55:35,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=092db5a7b358fa9c4c7ac039923503da, ASSIGN in 353 msec 2023-03-14 10:55:35,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:55:35,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791335718"}]},"ts":"1678791335718"} 2023-03-14 10:55:35,718 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-14 10:55:35,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:55:35,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1870 sec 2023-03-14 10:55:35,897 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-14 10:55:36,507 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/.tmp/family2/c93b882077cf4cd9b499092ed0a82d04 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/c93b882077cf4cd9b499092ed0a82d04 2023-03-14 10:55:36,512 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f7fb312194ae80d3a49902c6111928fc/family2 of f7fb312194ae80d3a49902c6111928fc into c93b882077cf4cd9b499092ed0a82d04(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:36,512 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:55:36,512 INFO [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc., storeName=f7fb312194ae80d3a49902c6111928fc/family2, priority=12, startTime=1678791333224; duration=1sec 2023-03-14 10:55:36,512 DEBUG [RS:0;jenkins-hbase4:36455-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:55:36,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488] to archive 2023-03-14 10:55:36,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:36,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-e14b82b5521448d6ba06c140e1fec2bd 2023-03-14 10:55:36,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-a921b65a97334b558be3614a58dea701 2023-03-14 10:55:36,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-eeec672e24dc48f1be6466ea05db27ce 2023-03-14 10:55:36,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/family2/testCompactionWithHFileLink=f7fb312194ae80d3a49902c6111928fc-5e3aceeaaf0c444193e6442d549e1488 2023-03-14 10:55:36,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 10:55:36,642 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-14 10:55:36,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:36,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:36,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:36,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:36,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 10:55:36,652 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 10:55:36,652 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:36,652 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 10:55:36,652 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 10:55:36,653 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:36,653 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:36,654 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:36,654 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:36,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:36,654 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:36,654 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:36,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:36,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 10:55:36,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 10:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 10:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 10:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:36,655 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. started... 2023-03-14 10:55:36,656 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. started... 2023-03-14 10:55:36,656 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. started... 2023-03-14 10:55:36,658 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bd77aa6bd2a692fa7c5691f440172e99 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:36,658 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fde00c7405357fc882bfdd228054e155 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:36,658 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 092db5a7b358fa9c4c7ac039923503da 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:55:36,676 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031435f710ff9df04808be1e7325c479b341 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031435f710ff9df04808be1e7325c479b341 2023-03-14 10:55:36,677 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303145e0649c7528b44a78e0cd3572844f636 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303145e0649c7528b44a78e0cd3572844f636 2023-03-14 10:55:36,681 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/e06d35cc5b524509b59338769e4d0a5a 2023-03-14 10:55:37,074 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314fa785d168c7e4a108adaf154cc4eee9a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314fa785d168c7e4a108adaf154cc4eee9a 2023-03-14 10:55:37,088 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/d69e57b4912540bf858d0836a7a9331c 2023-03-14 10:55:37,093 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314770317260d1446e68b5d6c5cb2ce7ec8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314770317260d1446e68b5d6c5cb2ce7ec8 2023-03-14 10:55:37,106 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/c037ebc2693b45a08df4526822b6715d 2023-03-14 10:55:37,111 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/e06d35cc5b524509b59338769e4d0a5a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a 2023-03-14 10:55:37,115 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:37,116 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/c037ebc2693b45a08df4526822b6715d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d 2023-03-14 10:55:37,119 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:37,120 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 092db5a7b358fa9c4c7ac039923503da in 463ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:37,121 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:37,479 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/b2d6ba2e074e474ba50fd63b6dffdd7b 2023-03-14 10:55:37,509 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303148422e7ebe02e47509bbce9c2a4030dff to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303148422e7ebe02e47509bbce9c2a4030dff 2023-03-14 10:55:37,892 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314416e540506a0433d85c646343dd5b890 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314416e540506a0433d85c646343dd5b890 2023-03-14 10:55:37,917 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/5c1ba93ed92743818fde5e0e39076bb8 2023-03-14 10:55:37,921 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/d69e57b4912540bf858d0836a7a9331c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c 2023-03-14 10:55:37,924 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:37,924 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/5c1ba93ed92743818fde5e0e39076bb8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8 2023-03-14 10:55:37,927 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:37,928 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bd77aa6bd2a692fa7c5691f440172e99 in 1271ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:37,928 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:37,928 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:37,928 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:38,297 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/52ec3a18da44438490ef987c478d5994 2023-03-14 10:55:38,302 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/b2d6ba2e074e474ba50fd63b6dffdd7b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b 2023-03-14 10:55:38,305 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 10:55:38,306 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/52ec3a18da44438490ef987c478d5994 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994 2023-03-14 10:55:38,309 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:55:38,310 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fde00c7405357fc882bfdd228054e155 in 1652ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:38,310 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:38,310 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:38,310 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 10:55:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 10:55:38,312 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,312 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:38,312 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,312 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:38,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:38,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:38,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:38,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 10:55:38,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b15fee1[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:38,314 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 10:55:38,314 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,315 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,315 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 10:55:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 10:55:38,316 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:38,316 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,316 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:38,317 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 10:55:38,317 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,317 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:38,317 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 10:55:38,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:38,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:38,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 10:55:38,319 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 10:55:38,320 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:38,320 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:38,320 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 10:55:38,320 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:38,323 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,323 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:38,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,323 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:38,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:38,323 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,325 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,327 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,327 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:38,327 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:38,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 10:55:38,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:38,327 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:38,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:38,327 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:38,327 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:38,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:38,328 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,428 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:38,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:38,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:38,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:38,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:38,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:38,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:38,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 10:55:38,436 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 10:55:38,436 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:38,436 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 10:55:38,436 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 10:55:38,436 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,436 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:38,437 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,437 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:38,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:38,438 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:38,438 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:38,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:38,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 10:55:38,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 10:55:38,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 10:55:38,439 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 10:55:38,439 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:38,439 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 10:55:38,439 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:38,439 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. started... 2023-03-14 10:55:38,439 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:38,440 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:38,440 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:38,440 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 092db5a7b358fa9c4c7ac039923503da 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:38,440 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:38,440 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. started... 2023-03-14 10:55:38,440 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. started... 2023-03-14 10:55:38,440 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bd77aa6bd2a692fa7c5691f440172e99 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:38,440 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fde00c7405357fc882bfdd228054e155 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:55:38,854 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303147d4c9801be9b4e439d6dcbe113f6a12b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303147d4c9801be9b4e439d6dcbe113f6a12b 2023-03-14 10:55:38,858 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031475afce46abe347efa80e755748df9b5f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031475afce46abe347efa80e755748df9b5f 2023-03-14 10:55:38,858 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303145d11b03c6d5d47a3b5a9f728bd8c8a3e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303145d11b03c6d5d47a3b5a9f728bd8c8a3e 2023-03-14 10:55:38,873 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/22e827a7be924bb7a12a38da0ad9d9e2 2023-03-14 10:55:38,888 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314c3aaa88f5dc24832ba0ec2275f4f241c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314c3aaa88f5dc24832ba0ec2275f4f241c 2023-03-14 10:55:39,259 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/63581bf8283b417da5054a104ce429c4 2023-03-14 10:55:39,271 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/a9d5f7d002b04f9da92033f6b0fd4a21 2023-03-14 10:55:39,291 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031429a4001125cb4f0bb4eb42e19f362bed to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023031429a4001125cb4f0bb4eb42e19f362bed 2023-03-14 10:55:39,293 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/57633fb265d749fdb958c4ea3f5c6266 2023-03-14 10:55:39,296 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/8717c0592a9e427bbab91a290d433db4 2023-03-14 10:55:39,297 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/22e827a7be924bb7a12a38da0ad9d9e2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2 2023-03-14 10:55:39,302 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:39,302 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/57633fb265d749fdb958c4ea3f5c6266 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266 2023-03-14 10:55:39,302 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/a9d5f7d002b04f9da92033f6b0fd4a21 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21 2023-03-14 10:55:39,306 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:39,306 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:39,307 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fde00c7405357fc882bfdd228054e155 in 867ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:39,307 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/8717c0592a9e427bbab91a290d433db4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4 2023-03-14 10:55:39,307 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:39,307 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:39,307 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:39,310 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:39,310 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bd77aa6bd2a692fa7c5691f440172e99 in 870ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:39,311 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:39,311 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:39,311 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:39,680 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303143ba64c9df7d343ef87b07ed18da3c586 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303143ba64c9df7d343ef87b07ed18da3c586 2023-03-14 10:55:40,085 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/297669bafd804d8f912a09a9c23487e4 2023-03-14 10:55:40,089 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/63581bf8283b417da5054a104ce429c4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4 2023-03-14 10:55:40,093 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 10:55:40,094 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/297669bafd804d8f912a09a9c23487e4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4 2023-03-14 10:55:40,098 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:55:40,099 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 092db5a7b358fa9c4c7ac039923503da in 1659ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:40,099 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:40,099 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 10:55:40,099 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 10:55:40,101 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,101 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:40,101 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,101 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:40,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 10:55:40,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25fadf02[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:40,102 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 10:55:40,103 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,105 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,105 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 10:55:40,105 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 10:55:40,105 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:40,105 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,105 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:40,109 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 10:55:40,109 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:40,109 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,109 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 10:55:40,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:40,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:40,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:40,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:40,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:40,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:40,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 10:55:40,112 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 10:55:40,112 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:40,112 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:40,112 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 10:55:40,112 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:40,114 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:40,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:40,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:40,114 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:40,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,116 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:40,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:40,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:40,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:40,119 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 10:55:40,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:40,119 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:40,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:40,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:40,120 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,120 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:40,120 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:40,220 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:40,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:40,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:40,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:40,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:40,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:40,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:40,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 10:55:40,227 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 10:55:40,227 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:40,227 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 10:55:40,227 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 10:55:40,228 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,228 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:40,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,230 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:40,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:40,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:40,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:40,230 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:40,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:40,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:40,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 10:55:40,231 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 10:55:40,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 10:55:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 10:55:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:40,232 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:40,232 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. started... 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. started... 2023-03-14 10:55:40,232 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. started... 2023-03-14 10:55:40,232 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 092db5a7b358fa9c4c7ac039923503da 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:40,232 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bd77aa6bd2a692fa7c5691f440172e99 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:40,232 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fde00c7405357fc882bfdd228054e155 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:55:40,649 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314b7c3670445ff463ab614e970595261e6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230314b7c3670445ff463ab614e970595261e6 2023-03-14 10:55:40,649 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031443aede7925334d6998de55e216bc7f5a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031443aede7925334d6998de55e216bc7f5a 2023-03-14 10:55:40,649 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303141f717b540b8c4642a5d2d45f759afee5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303141f717b540b8c4642a5d2d45f759afee5 2023-03-14 10:55:41,054 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/c04f23e6204848c0a77a59aa86d29c8d 2023-03-14 10:55:41,054 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/8760cc365f4b4322bec841269050a7b3 2023-03-14 10:55:41,055 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/93142a8b53ed4fefbc3914cf836a24d0 2023-03-14 10:55:41,069 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314494214eae43e4d4996bd34d95a9b7ddf to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314494214eae43e4d4996bd34d95a9b7ddf 2023-03-14 10:55:41,070 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314217b00bac57a4ccbad36fc5a93dc9821 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230314217b00bac57a4ccbad36fc5a93dc9821 2023-03-14 10:55:41,070 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303146042c119e6d84e9bb28bb83b1cd7d0e2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303146042c119e6d84e9bb28bb83b1cd7d0e2 2023-03-14 10:55:41,075 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/d74cb7e8201d4399ae0e4db41b5ba01a 2023-03-14 10:55:41,078 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/93142a8b53ed4fefbc3914cf836a24d0 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0 2023-03-14 10:55:41,080 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:41,081 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/d74cb7e8201d4399ae0e4db41b5ba01a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a 2023-03-14 10:55:41,084 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:41,085 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bd77aa6bd2a692fa7c5691f440172e99 in 853ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:41,085 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:41,085 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:41,085 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:41,176 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:55:41,474 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/93d896e6dd804b6e836ac726d62b151e 2023-03-14 10:55:41,475 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/0ae09a2e8ef84bd4aabed77d949e0f85 2023-03-14 10:55:41,478 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/c04f23e6204848c0a77a59aa86d29c8d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d 2023-03-14 10:55:41,479 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/8760cc365f4b4322bec841269050a7b3 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3 2023-03-14 10:55:41,481 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:41,482 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/93d896e6dd804b6e836ac726d62b151e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e 2023-03-14 10:55:41,482 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 10:55:41,483 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/0ae09a2e8ef84bd4aabed77d949e0f85 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85 2023-03-14 10:55:41,486 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:41,486 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:55:41,487 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 092db5a7b358fa9c4c7ac039923503da in 1255ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:41,487 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fde00c7405357fc882bfdd228054e155 in 1255ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:41,487 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:41,487 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:41,487 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:41,487 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 10:55:41,487 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 10:55:41,489 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,489 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,490 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 10:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339b1c51[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:41,491 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 10:55:41,491 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,492 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 10:55:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 10:55:41,492 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:41,493 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,493 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:41,494 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 10:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:41,494 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 10:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 10:55:41,496 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 10:55:41,496 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:41,496 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:41,496 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 10:55:41,496 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:41,498 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,498 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,498 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:41,499 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,500 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,503 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:41,503 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,503 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:41,503 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:41,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:41,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:41,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 10:55:41,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:41,503 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:41,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:41,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 10:55:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:41,504 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:41,604 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:41,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:41,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:41,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:41,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:55:41,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:41,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 10:55:41,611 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 10:55:41,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:41,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 10:55:41,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 10:55:41,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,611 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:41,612 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,612 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:41,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:41,613 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:41,613 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:41,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 10:55:41,614 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 10:55:41,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 10:55:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 10:55:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. started... 2023-03-14 10:55:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. started... 2023-03-14 10:55:41,614 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 092db5a7b358fa9c4c7ac039923503da 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:41,614 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. started... 2023-03-14 10:55:41,614 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fde00c7405357fc882bfdd228054e155 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:41,615 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bd77aa6bd2a692fa7c5691f440172e99 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:55:41,629 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314ae0c83e64de64cb7a81d757d76e6ee92 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314ae0c83e64de64cb7a81d757d76e6ee92 2023-03-14 10:55:42,029 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303149f11f70698b446e4978733f5359d5ff0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303149f11f70698b446e4978733f5359d5ff0 2023-03-14 10:55:42,030 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314ff9520ab14714774ab13223597749427 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230314ff9520ab14714774ab13223597749427 2023-03-14 10:55:42,033 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/466b2df65ce34b1a8b88faf6256c8a8f 2023-03-14 10:55:42,435 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/ef84eebe225a4de48718828c8c4cc9c6 2023-03-14 10:55:42,435 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/849dda8c38fd4c939d57f153eba08f55 2023-03-14 10:55:42,447 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314e369302d3c7e4d8b9a16e64d62aa6c29 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314e369302d3c7e4d8b9a16e64d62aa6c29 2023-03-14 10:55:42,850 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303147f406862cca24d61bb5351994ce69dce to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303147f406862cca24d61bb5351994ce69dce 2023-03-14 10:55:42,850 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314e924d8a6b911420383e751b2232957bc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314e924d8a6b911420383e751b2232957bc 2023-03-14 10:55:42,851 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/35ec42b4ec61479da3bafc6cf82940c4 2023-03-14 10:55:42,855 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/a602f1c6e91845f0a5a353969f1cdf01 2023-03-14 10:55:42,855 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/466b2df65ce34b1a8b88faf6256c8a8f as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f 2023-03-14 10:55:42,856 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/80c740ad91be4250b0619c6a69e6e5d8 2023-03-14 10:55:42,859 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:42,859 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/849dda8c38fd4c939d57f153eba08f55 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55 2023-03-14 10:55:42,860 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/ef84eebe225a4de48718828c8c4cc9c6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6 2023-03-14 10:55:42,861 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/35ec42b4ec61479da3bafc6cf82940c4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4 2023-03-14 10:55:42,863 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:42,863 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 10:55:42,863 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/a602f1c6e91845f0a5a353969f1cdf01 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01 2023-03-14 10:55:42,864 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/80c740ad91be4250b0619c6a69e6e5d8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8 2023-03-14 10:55:42,865 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:42,865 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fde00c7405357fc882bfdd228054e155 in 1251ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:42,865 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:42,865 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:42,867 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:42,868 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:55:42,868 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 092db5a7b358fa9c4c7ac039923503da in 1254ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:42,868 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bd77aa6bd2a692fa7c5691f440172e99 in 1254ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 10:55:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 10:55:42,870 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:42,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 10:55:42,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65a2508c[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:42,871 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 10:55:42,871 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,872 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,872 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,873 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 10:55:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 10:55:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:42,874 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 10:55:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 10:55:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:42,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 10:55:42,876 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 10:55:42,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:42,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:42,876 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 10:55:42,876 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:42,878 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,878 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,878 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:42,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:42,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:42,879 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:42,880 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:42,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,881 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:42,881 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:42,882 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:42,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:42,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 10:55:42,882 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 10:55:42,882 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:42,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:42,882 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:42,982 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:42,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:42,994 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:43,004 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:43,014 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:43,015 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:43,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:43,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:43,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 10:55:43,046 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 10:55:43,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:43,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 10:55:43,046 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 10:55:43,047 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:43,047 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:43,048 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:43,048 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:43,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:43,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:43,049 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:43,049 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:43,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:43,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:43,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:43,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:43,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 10:55:43,050 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 10:55:43,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 10:55:43,050 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 10:55:43,050 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:43,050 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:43,050 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. started... 2023-03-14 10:55:43,050 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. started... 2023-03-14 10:55:43,050 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bd77aa6bd2a692fa7c5691f440172e99 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:43,050 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. started... 2023-03-14 10:55:43,050 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 092db5a7b358fa9c4c7ac039923503da 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:43,050 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing fde00c7405357fc882bfdd228054e155 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:55:43,469 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/db0b46d5d333422a9cc19b879d18a340 2023-03-14 10:55:43,473 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/2fa958f1426f4042a1420baeb948742c 2023-03-14 10:55:43,474 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db0b46d5d333422a9cc19b879d18a340 2023-03-14 10:55:43,490 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fa958f1426f4042a1420baeb948742c 2023-03-14 10:55:43,491 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:43,491 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3865866b to 127.0.0.1:58692 2023-03-14 10:55:43,491 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:43,491 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:55:43,491 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c526350 to 127.0.0.1:58692 2023-03-14 10:55:43,492 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:55:43,506 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/3eff6f2a8d274ec58957fc31f2178468 2023-03-14 10:55:43,509 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3eff6f2a8d274ec58957fc31f2178468 2023-03-14 10:55:43,510 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/db0b46d5d333422a9cc19b879d18a340 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340 2023-03-14 10:55:43,513 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db0b46d5d333422a9cc19b879d18a340 2023-03-14 10:55:43,513 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:43,514 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/3eff6f2a8d274ec58957fc31f2178468 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468 2023-03-14 10:55:43,518 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3eff6f2a8d274ec58957fc31f2178468 2023-03-14 10:55:43,518 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:43,519 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 092db5a7b358fa9c4c7ac039923503da in 469ms, sequenceid=23, compaction requested=true 2023-03-14 10:55:43,519 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:43,519 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:55:43,872 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/f77a74bc38d84985834b703f1e379364 2023-03-14 10:55:43,876 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f77a74bc38d84985834b703f1e379364 2023-03-14 10:55:44,307 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/f1e4d05bfbc5471fbdb6c265d0e84122 2023-03-14 10:55:44,310 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1e4d05bfbc5471fbdb6c265d0e84122 2023-03-14 10:55:44,311 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/2fa958f1426f4042a1420baeb948742c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c 2023-03-14 10:55:44,314 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fa958f1426f4042a1420baeb948742c 2023-03-14 10:55:44,314 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:44,315 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/f1e4d05bfbc5471fbdb6c265d0e84122 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122 2023-03-14 10:55:44,318 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1e4d05bfbc5471fbdb6c265d0e84122 2023-03-14 10:55:44,318 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:44,318 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bd77aa6bd2a692fa7c5691f440172e99 in 1268ms, sequenceid=23, compaction requested=true 2023-03-14 10:55:44,319 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:44,319 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:44,319 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:55:44,691 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/9c654816793f41b8a135963dd9f547bd 2023-03-14 10:55:44,695 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c654816793f41b8a135963dd9f547bd 2023-03-14 10:55:44,695 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/f77a74bc38d84985834b703f1e379364 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364 2023-03-14 10:55:44,698 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f77a74bc38d84985834b703f1e379364 2023-03-14 10:55:44,699 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:44,699 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/9c654816793f41b8a135963dd9f547bd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd 2023-03-14 10:55:44,703 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c654816793f41b8a135963dd9f547bd 2023-03-14 10:55:44,703 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:55:44,703 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fde00c7405357fc882bfdd228054e155 in 1653ms, sequenceid=23, compaction requested=true 2023-03-14 10:55:44,703 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:44,704 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:44,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:55:44,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:55:44,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 10:55:44,704 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 10:55:44,705 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,705 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:44,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:44,706 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,706 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:44,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:44,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:44,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:44,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 10:55:44,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c4582f[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:44,707 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 10:55:44,707 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,708 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 10:55:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 10:55:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:44,708 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,708 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:44,713 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 10:55:44,713 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:44,713 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,713 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 10:55:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:44,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:44,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:44,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:44,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 10:55:44,715 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 10:55:44,715 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:44,715 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:44,715 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 10:55:44,715 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:44,716 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,716 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:44,717 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:44,717 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:44,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,718 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:44,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 10:55:44,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:44,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:44,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:44,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 10:55:44,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:44,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:44,720 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:44,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:44,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:44,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:44,720 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 10:55:44,721 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 10:55:44,821 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:44,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:44,822 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:44,822 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 092db5a7b358fa9c4c7ac039923503da/family1 is initiating major compaction (all files) 2023-03-14 10:55:44,822 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:44,822 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:44,823 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 092db5a7b358fa9c4c7ac039923503da/family1 in ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:44,823 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp, totalSize=26.6 K 2023-03-14 10:55:44,823 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting e06d35cc5b524509b59338769e4d0a5a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336648 2023-03-14 10:55:44,823 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 63581bf8283b417da5054a104ce429c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338431 2023-03-14 10:55:44,824 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c04f23e6204848c0a77a59aa86d29c8d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340222 2023-03-14 10:55:44,824 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 849dda8c38fd4c939d57f153eba08f55, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341606 2023-03-14 10:55:44,824 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting db0b46d5d333422a9cc19b879d18a340, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:44,832 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 092db5a7b358fa9c4c7ac039923503da#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:45,242 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314fc8f03344db94504b296da1be499ce09_del 2023-03-14 10:55:45,242 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314fc8f03344db94504b296da1be499ce09_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230314fc8f03344db94504b296da1be499ce09_del 2023-03-14 10:55:46,055 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30844979d2454af4afc561d7a8cc8c39 2023-03-14 10:55:46,056 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family1/30844979d2454af4afc561d7a8cc8c39 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/30844979d2454af4afc561d7a8cc8c39 2023-03-14 10:55:46,059 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30844979d2454af4afc561d7a8cc8c39 2023-03-14 10:55:46,060 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 092db5a7b358fa9c4c7ac039923503da/family1 of 092db5a7b358fa9c4c7ac039923503da into 30844979d2454af4afc561d7a8cc8c39(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:46,060 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:46,061 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:46,061 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 092db5a7b358fa9c4c7ac039923503da/family2 is initiating major compaction (all files) 2023-03-14 10:55:46,061 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:46,061 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:46,061 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 092db5a7b358fa9c4c7ac039923503da/family2 in ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:55:46,061 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp, totalSize=25.3 K 2023-03-14 10:55:46,061 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c037ebc2693b45a08df4526822b6715d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336648 2023-03-14 10:55:46,062 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 297669bafd804d8f912a09a9c23487e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338431 2023-03-14 10:55:46,062 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 93d896e6dd804b6e836ac726d62b151e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340222 2023-03-14 10:55:46,062 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a602f1c6e91845f0a5a353969f1cdf01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341606 2023-03-14 10:55:46,063 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 3eff6f2a8d274ec58957fc31f2178468, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:46,071 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 092db5a7b358fa9c4c7ac039923503da#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:46,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340] to archive 2023-03-14 10:55:46,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:46,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/e06d35cc5b524509b59338769e4d0a5a 2023-03-14 10:55:46,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/63581bf8283b417da5054a104ce429c4 2023-03-14 10:55:46,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/c04f23e6204848c0a77a59aa86d29c8d 2023-03-14 10:55:46,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/849dda8c38fd4c939d57f153eba08f55 2023-03-14 10:55:46,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/db0b46d5d333422a9cc19b879d18a340 2023-03-14 10:55:46,485 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303142f9ab6ce3755479bba87810811a4ae87_del 2023-03-14 10:55:46,486 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303142f9ab6ce3755479bba87810811a4ae87_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303142f9ab6ce3755479bba87810811a4ae87_del 2023-03-14 10:55:47,298 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15e4ef39d0654c2d99d2c7eefb716664 2023-03-14 10:55:47,298 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/.tmp/family2/15e4ef39d0654c2d99d2c7eefb716664 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/15e4ef39d0654c2d99d2c7eefb716664 2023-03-14 10:55:47,301 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15e4ef39d0654c2d99d2c7eefb716664 2023-03-14 10:55:47,302 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 092db5a7b358fa9c4c7ac039923503da/family2 of 092db5a7b358fa9c4c7ac039923503da into 15e4ef39d0654c2d99d2c7eefb716664(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:47,302 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:47,302 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:47,302 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): fde00c7405357fc882bfdd228054e155/family1 is initiating major compaction (all files) 2023-03-14 10:55:47,302 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:47,303 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:47,303 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of fde00c7405357fc882bfdd228054e155/family1 in ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:47,303 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp, totalSize=26.6 K 2023-03-14 10:55:47,303 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting b2d6ba2e074e474ba50fd63b6dffdd7b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336649 2023-03-14 10:55:47,303 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 22e827a7be924bb7a12a38da0ad9d9e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338432 2023-03-14 10:55:47,304 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 8760cc365f4b4322bec841269050a7b3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340223 2023-03-14 10:55:47,304 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 466b2df65ce34b1a8b88faf6256c8a8f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341607 2023-03-14 10:55:47,304 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting f77a74bc38d84985834b703f1e379364, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:47,311 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): fde00c7405357fc882bfdd228054e155#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:47,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468] to archive 2023-03-14 10:55:47,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:47,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/c037ebc2693b45a08df4526822b6715d 2023-03-14 10:55:47,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/297669bafd804d8f912a09a9c23487e4 2023-03-14 10:55:47,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/93d896e6dd804b6e836ac726d62b151e 2023-03-14 10:55:47,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/a602f1c6e91845f0a5a353969f1cdf01 2023-03-14 10:55:47,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family2/3eff6f2a8d274ec58957fc31f2178468 2023-03-14 10:55:47,718 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314619c99f411d04e6588d601de91623b29_del 2023-03-14 10:55:47,718 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314619c99f411d04e6588d601de91623b29_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314619c99f411d04e6588d601de91623b29_del 2023-03-14 10:55:48,532 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd7a6d6c34354597b0d12e03d7f41dbf 2023-03-14 10:55:48,532 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family1/dd7a6d6c34354597b0d12e03d7f41dbf as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/dd7a6d6c34354597b0d12e03d7f41dbf 2023-03-14 10:55:48,535 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd7a6d6c34354597b0d12e03d7f41dbf 2023-03-14 10:55:48,536 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fde00c7405357fc882bfdd228054e155/family1 of fde00c7405357fc882bfdd228054e155 into dd7a6d6c34354597b0d12e03d7f41dbf(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:48,536 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:48,536 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:48,537 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): fde00c7405357fc882bfdd228054e155/family2 is initiating major compaction (all files) 2023-03-14 10:55:48,537 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:48,537 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:48,537 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of fde00c7405357fc882bfdd228054e155/family2 in ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:55:48,537 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp, totalSize=25.3 K 2023-03-14 10:55:48,537 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 52ec3a18da44438490ef987c478d5994, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336649 2023-03-14 10:55:48,538 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 57633fb265d749fdb958c4ea3f5c6266, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338432 2023-03-14 10:55:48,538 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 0ae09a2e8ef84bd4aabed77d949e0f85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340223 2023-03-14 10:55:48,538 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 35ec42b4ec61479da3bafc6cf82940c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341607 2023-03-14 10:55:48,538 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 9c654816793f41b8a135963dd9f547bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:48,546 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): fde00c7405357fc882bfdd228054e155#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:48,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364] to archive 2023-03-14 10:55:48,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:48,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/b2d6ba2e074e474ba50fd63b6dffdd7b 2023-03-14 10:55:48,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/22e827a7be924bb7a12a38da0ad9d9e2 2023-03-14 10:55:48,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/8760cc365f4b4322bec841269050a7b3 2023-03-14 10:55:48,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/466b2df65ce34b1a8b88faf6256c8a8f 2023-03-14 10:55:48,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/f77a74bc38d84985834b703f1e379364 2023-03-14 10:55:48,953 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314c7cd25dd9e95472a9157d5c5136ae54c_del 2023-03-14 10:55:48,953 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314c7cd25dd9e95472a9157d5c5136ae54c_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314c7cd25dd9e95472a9157d5c5136ae54c_del 2023-03-14 10:55:49,767 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9922f9babc454d4282c47fa126c5776e 2023-03-14 10:55:49,768 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/.tmp/family2/9922f9babc454d4282c47fa126c5776e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9922f9babc454d4282c47fa126c5776e 2023-03-14 10:55:49,771 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9922f9babc454d4282c47fa126c5776e 2023-03-14 10:55:49,772 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fde00c7405357fc882bfdd228054e155/family2 of fde00c7405357fc882bfdd228054e155 into 9922f9babc454d4282c47fa126c5776e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:49,772 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:49,772 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:49,772 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): bd77aa6bd2a692fa7c5691f440172e99/family1 is initiating major compaction (all files) 2023-03-14 10:55:49,772 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:49,772 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:49,773 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of bd77aa6bd2a692fa7c5691f440172e99/family1 in ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:49,773 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp, totalSize=26.6 K 2023-03-14 10:55:49,773 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting d69e57b4912540bf858d0836a7a9331c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336648 2023-03-14 10:55:49,774 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a9d5f7d002b04f9da92033f6b0fd4a21, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338431 2023-03-14 10:55:49,774 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 93142a8b53ed4fefbc3914cf836a24d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340223 2023-03-14 10:55:49,774 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting ef84eebe225a4de48718828c8c4cc9c6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341606 2023-03-14 10:55:49,774 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 2fa958f1426f4042a1420baeb948742c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:49,782 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): bd77aa6bd2a692fa7c5691f440172e99#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:49,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd] to archive 2023-03-14 10:55:49,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:49,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/52ec3a18da44438490ef987c478d5994 2023-03-14 10:55:49,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/57633fb265d749fdb958c4ea3f5c6266 2023-03-14 10:55:49,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/0ae09a2e8ef84bd4aabed77d949e0f85 2023-03-14 10:55:49,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/35ec42b4ec61479da3bafc6cf82940c4 2023-03-14 10:55:49,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family2/9c654816793f41b8a135963dd9f547bd 2023-03-14 10:55:50,189 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031467e6454ac3ad4ba383742c1c52b446dc_del 2023-03-14 10:55:50,189 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031467e6454ac3ad4ba383742c1c52b446dc_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031467e6454ac3ad4ba383742c1c52b446dc_del 2023-03-14 10:55:51,003 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dcf8435f13a4c5981a2c2a2a0603520 2023-03-14 10:55:51,003 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family1/0dcf8435f13a4c5981a2c2a2a0603520 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/0dcf8435f13a4c5981a2c2a2a0603520 2023-03-14 10:55:51,007 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0dcf8435f13a4c5981a2c2a2a0603520 2023-03-14 10:55:51,008 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bd77aa6bd2a692fa7c5691f440172e99/family1 of bd77aa6bd2a692fa7c5691f440172e99 into 0dcf8435f13a4c5981a2c2a2a0603520(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:51,008 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:51,008 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:55:51,008 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): bd77aa6bd2a692fa7c5691f440172e99/family2 is initiating major compaction (all files) 2023-03-14 10:55:51,008 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:55:51,008 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:55:51,009 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of bd77aa6bd2a692fa7c5691f440172e99/family2 in ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:55:51,009 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp, totalSize=25.3 K 2023-03-14 10:55:51,010 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 5c1ba93ed92743818fde5e0e39076bb8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791336648 2023-03-14 10:55:51,010 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 8717c0592a9e427bbab91a290d433db4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791338431 2023-03-14 10:55:51,010 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting d74cb7e8201d4399ae0e4db41b5ba01a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791340223 2023-03-14 10:55:51,011 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 80c740ad91be4250b0619c6a69e6e5d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791341606 2023-03-14 10:55:51,011 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting f1e4d05bfbc5471fbdb6c265d0e84122, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:55:51,020 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): bd77aa6bd2a692fa7c5691f440172e99#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:55:51,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c] to archive 2023-03-14 10:55:51,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:51,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/d69e57b4912540bf858d0836a7a9331c 2023-03-14 10:55:51,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/a9d5f7d002b04f9da92033f6b0fd4a21 2023-03-14 10:55:51,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/93142a8b53ed4fefbc3914cf836a24d0 2023-03-14 10:55:51,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/ef84eebe225a4de48718828c8c4cc9c6 2023-03-14 10:55:51,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/2fa958f1426f4042a1420baeb948742c 2023-03-14 10:55:51,432 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031470798063ca1a49b1ac145d8120de7550_del 2023-03-14 10:55:51,432 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031470798063ca1a49b1ac145d8120de7550_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023031470798063ca1a49b1ac145d8120de7550_del 2023-03-14 10:55:52,246 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28a4d8b737743ac994b96d48d739865 2023-03-14 10:55:52,247 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/.tmp/family2/c28a4d8b737743ac994b96d48d739865 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/c28a4d8b737743ac994b96d48d739865 2023-03-14 10:55:52,250 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c28a4d8b737743ac994b96d48d739865 2023-03-14 10:55:52,251 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bd77aa6bd2a692fa7c5691f440172e99/family2 of bd77aa6bd2a692fa7c5691f440172e99 into c28a4d8b737743ac994b96d48d739865(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:55:52,251 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:52,254 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:52,256 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:52,259 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:52,260 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:52,265 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:55:52,275 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-14 10:55:52,278 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314fc8f03344db94504b296da1be499ce09_del 2023-03-14 10:55:52,280 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031467e6454ac3ad4ba383742c1c52b446dc_del 2023-03-14 10:55:52,282 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314619c99f411d04e6588d601de91623b29_del 2023-03-14 10:55:52,282 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:52,283 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(139): Connect 0x69b16590 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:55:52,287 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19affb6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:55:52,288 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:52,288 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:52,288 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:52,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122] to archive 2023-03-14 10:55:52,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:52,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/5c1ba93ed92743818fde5e0e39076bb8 2023-03-14 10:55:52,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/8717c0592a9e427bbab91a290d433db4 2023-03-14 10:55:52,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/d74cb7e8201d4399ae0e4db41b5ba01a 2023-03-14 10:55:52,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/80c740ad91be4250b0619c6a69e6e5d8 2023-03-14 10:55:52,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family2/f1e4d05bfbc5471fbdb6c265d0e84122 2023-03-14 10:55:52,725 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031485604dbbc76b4d6dbef171c944a3e061 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031485604dbbc76b4d6dbef171c944a3e061 2023-03-14 10:55:52,726 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303147a1d1c03898a4c5392166aa88404cb9d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303147a1d1c03898a4c5392166aa88404cb9d 2023-03-14 10:55:52,726 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:52,726 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:52,740 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:55:52,742 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39716, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:55:52,752 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:55:52,755 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51524, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:55:52,774 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/54a0ab32eded446482c20c05d541315d first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-14 10:55:52,774 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/76bb224c03994b3792d2a29d1018ca29 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-14 10:55:52,775 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/54a0ab32eded446482c20c05d541315d}] 2023-03-14 10:55:52,775 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/76bb224c03994b3792d2a29d1018ca29}] 2023-03-14 10:55:52,784 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/54a0ab32eded446482c20c05d541315d for inclusion in bd77aa6bd2a692fa7c5691f440172e99/family1 2023-03-14 10:55:52,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/76bb224c03994b3792d2a29d1018ca29 for inclusion in fde00c7405357fc882bfdd228054e155/family1 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:55:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/54a0ab32eded446482c20c05d541315d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__uio1f2dvh26cre5g2kvv55bf1dn8epb3fafi78n273soomklccsvsn291n1r0n99/family1/54a0ab32eded446482c20c05d541315d 2023-03-14 10:55:52,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/76bb224c03994b3792d2a29d1018ca29 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__tn04mbao01vifmapg02ocvq9s41p9e036qb3eeqllh75hqj7gs7ofju979g245oe/family1/76bb224c03994b3792d2a29d1018ca29 2023-03-14 10:55:52,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__uio1f2dvh26cre5g2kvv55bf1dn8epb3fafi78n273soomklccsvsn291n1r0n99/family1/54a0ab32eded446482c20c05d541315d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/91f6ea6a6686458aaae27fffef1ab952_SeqId_28_ 2023-03-14 10:55:52,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__tn04mbao01vifmapg02ocvq9s41p9e036qb3eeqllh75hqj7gs7ofju979g245oe/family1/76bb224c03994b3792d2a29d1018ca29 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/6411da2f8f474380bfe6ac8247438d9f_SeqId_28_ 2023-03-14 10:55:52,789 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__uio1f2dvh26cre5g2kvv55bf1dn8epb3fafi78n273soomklccsvsn291n1r0n99/family1/54a0ab32eded446482c20c05d541315d into bd77aa6bd2a692fa7c5691f440172e99/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/91f6ea6a6686458aaae27fffef1ab952_SeqId_28_ - updating store file list. 2023-03-14 10:55:52,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__tn04mbao01vifmapg02ocvq9s41p9e036qb3eeqllh75hqj7gs7ofju979g245oe/family1/76bb224c03994b3792d2a29d1018ca29 into fde00c7405357fc882bfdd228054e155/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/6411da2f8f474380bfe6ac8247438d9f_SeqId_28_ - updating store file list. 2023-03-14 10:55:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/6411da2f8f474380bfe6ac8247438d9f_SeqId_28_ into fde00c7405357fc882bfdd228054e155/family1 2023-03-14 10:55:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/91f6ea6a6686458aaae27fffef1ab952_SeqId_28_ into bd77aa6bd2a692fa7c5691f440172e99/family1 2023-03-14 10:55:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__tn04mbao01vifmapg02ocvq9s41p9e036qb3eeqllh75hqj7gs7ofju979g245oe/family1/76bb224c03994b3792d2a29d1018ca29 into fde00c7405357fc882bfdd228054e155/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/family1/6411da2f8f474380bfe6ac8247438d9f_SeqId_28_) 2023-03-14 10:55:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__uio1f2dvh26cre5g2kvv55bf1dn8epb3fafi78n273soomklccsvsn291n1r0n99/family1/54a0ab32eded446482c20c05d541315d into bd77aa6bd2a692fa7c5691f440172e99/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/family1/91f6ea6a6686458aaae27fffef1ab952_SeqId_28_) 2023-03-14 10:55:52,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__tn04mbao01vifmapg02ocvq9s41p9e036qb3eeqllh75hqj7gs7ofju979g245oe/family1/76bb224c03994b3792d2a29d1018ca29 2023-03-14 10:55:52,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__uio1f2dvh26cre5g2kvv55bf1dn8epb3fafi78n273soomklccsvsn291n1r0n99/family1/54a0ab32eded446482c20c05d541315d 2023-03-14 10:55:52,794 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:52,794 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:52,795 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:52,795 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:52,796 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314fa785d168c7e4a108adaf154cc4eee9a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314fa785d168c7e4a108adaf154cc4eee9a 2023-03-14 10:55:52,796 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303145e0649c7528b44a78e0cd3572844f636 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303145e0649c7528b44a78e0cd3572844f636 2023-03-14 10:55:52,796 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 10:55:52,796 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 10:55:52,796 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 10:55:52,796 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 10:55:52,796 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:52,796 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:53,124 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303146831c795738a4ea1a92213054c6ebe3c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303146831c795738a4ea1a92213054c6ebe3c 2023-03-14 10:55:53,125 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:53,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/1ae5b45b8a544030be8ba5e94ad08bba first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-14 10:55:53,148 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/1ae5b45b8a544030be8ba5e94ad08bba}] 2023-03-14 10:55:53,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/1ae5b45b8a544030be8ba5e94ad08bba for inclusion in 092db5a7b358fa9c4c7ac039923503da/family1 2023-03-14 10:55:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-14 10:55:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 10:55:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:55:53,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/1ae5b45b8a544030be8ba5e94ad08bba to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__5duj4a8kjvvk28kjbkk5uobaktbbeui0q2jifkjajfgbu4ou0e6b0s8u3lqb7usp/family1/1ae5b45b8a544030be8ba5e94ad08bba 2023-03-14 10:55:53,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__5duj4a8kjvvk28kjbkk5uobaktbbeui0q2jifkjajfgbu4ou0e6b0s8u3lqb7usp/family1/1ae5b45b8a544030be8ba5e94ad08bba as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/d1562f9cb28a4d6198294a854ef7053b_SeqId_28_ 2023-03-14 10:55:53,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__5duj4a8kjvvk28kjbkk5uobaktbbeui0q2jifkjajfgbu4ou0e6b0s8u3lqb7usp/family1/1ae5b45b8a544030be8ba5e94ad08bba into 092db5a7b358fa9c4c7ac039923503da/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/d1562f9cb28a4d6198294a854ef7053b_SeqId_28_ - updating store file list. 2023-03-14 10:55:53,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/d1562f9cb28a4d6198294a854ef7053b_SeqId_28_ into 092db5a7b358fa9c4c7ac039923503da/family1 2023-03-14 10:55:53,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__5duj4a8kjvvk28kjbkk5uobaktbbeui0q2jifkjajfgbu4ou0e6b0s8u3lqb7usp/family1/1ae5b45b8a544030be8ba5e94ad08bba into 092db5a7b358fa9c4c7ac039923503da/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/family1/d1562f9cb28a4d6198294a854ef7053b_SeqId_28_) 2023-03-14 10:55:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__ns_testMinorCompaction__5duj4a8kjvvk28kjbkk5uobaktbbeui0q2jifkjajfgbu4ou0e6b0s8u3lqb7usp/family1/1ae5b45b8a544030be8ba5e94ad08bba 2023-03-14 10:55:53,159 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:53,160 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:55:53,161 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031435f710ff9df04808be1e7325c479b341 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031435f710ff9df04808be1e7325c479b341 2023-03-14 10:55:53,161 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 10:55:53,161 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 10:55:53,161 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 10:55:53,161 INFO [Listener at localhost/44023] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-14 10:55:53,163 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:53,165 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:53,167 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:55:53,168 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:55:53,183 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 282), OpenFileDescriptor=623 (was 749), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 200), ProcessCount=169 (was 169), AvailableMemoryMB=2675 (was 2684) 2023-03-14 10:55:53,194 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=169, AvailableMemoryMB=2674 2023-03-14 10:55:53,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 10:55:53,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:53,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:55:53,197 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-14 10:55:53,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:55:53,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:53,199 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:53,199 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516 empty. 2023-03-14 10:55:53,200 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:53,200 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-14 10:55:53,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:53,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:53,606 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 10:55:53,607 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26af9fe197a28ba1491482613ddc1516, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:55:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:54,012 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:54,012 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 26af9fe197a28ba1491482613ddc1516, disabling compactions & flushes 2023-03-14 10:55:54,012 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,013 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,013 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. after waiting 0 ms 2023-03-14 10:55:54,013 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,013 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,013 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:54,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:55:54,016 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791354015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791354015"}]},"ts":"1678791354015"} 2023-03-14 10:55:54,017 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 10:55:54,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:55:54,018 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791354018"}]},"ts":"1678791354018"} 2023-03-14 10:55:54,018 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-14 10:55:54,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=26af9fe197a28ba1491482613ddc1516, ASSIGN}] 2023-03-14 10:55:54,023 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=26af9fe197a28ba1491482613ddc1516, ASSIGN 2023-03-14 10:55:54,023 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=26af9fe197a28ba1491482613ddc1516, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:55:54,174 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=26af9fe197a28ba1491482613ddc1516, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:54,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791354174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791354174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791354174"}]},"ts":"1678791354174"} 2023-03-14 10:55:54,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 26af9fe197a28ba1491482613ddc1516, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:55:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:54,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26af9fe197a28ba1491482613ddc1516, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.', STARTKEY => '', ENDKEY => ''} 2023-03-14 10:55:54,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:55:54,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,331 INFO [StoreOpener-26af9fe197a28ba1491482613ddc1516-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,333 DEBUG [StoreOpener-26af9fe197a28ba1491482613ddc1516-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:55:54,333 DEBUG [StoreOpener-26af9fe197a28ba1491482613ddc1516-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:55:54,333 INFO [StoreOpener-26af9fe197a28ba1491482613ddc1516-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26af9fe197a28ba1491482613ddc1516 columnFamilyName family1 2023-03-14 10:55:54,334 INFO [StoreOpener-26af9fe197a28ba1491482613ddc1516-1] regionserver.HStore(310): Store=26af9fe197a28ba1491482613ddc1516/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:55:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:55:54,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:55:54,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26af9fe197a28ba1491482613ddc1516; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61981257, jitterRate=-0.0764072984457016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 10:55:54,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:54,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., pid=114, masterSystemTime=1678791354327 2023-03-14 10:55:54,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:54,343 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=26af9fe197a28ba1491482613ddc1516, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:54,343 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678791354343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791354343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791354343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791354343"}]},"ts":"1678791354343"} 2023-03-14 10:55:54,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-14 10:55:54,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 26af9fe197a28ba1491482613ddc1516, server=jenkins-hbase4.apache.org,36455,1678791214611 in 168 msec 2023-03-14 10:55:54,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-14 10:55:54,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=26af9fe197a28ba1491482613ddc1516, ASSIGN in 324 msec 2023-03-14 10:55:54,347 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:55:54,347 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791354347"}]},"ts":"1678791354347"} 2023-03-14 10:55:54,348 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-14 10:55:54,351 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:55:54,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1550 sec 2023-03-14 10:55:55,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 10:55:55,304 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-14 10:55:55,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:55,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,321 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:55,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:55,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:55,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:55,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,321 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,322 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,322 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:55,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:55,323 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,323 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:55,328 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:55,328 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:55,329 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 10:55:55,354 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fa900aa7456c48a1a23522d44d05cf6e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130fa900aa7456c48a1a23522d44d05cf6e 2023-03-14 10:55:55,357 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/0e421bc1fbb34339a03e11626ac1d257 2023-03-14 10:55:55,361 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/0e421bc1fbb34339a03e11626ac1d257 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257 2023-03-14 10:55:55,365 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-14 10:55:55,366 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 36ms, sequenceid=5, compaction requested=false 2023-03-14 10:55:55,366 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:55,366 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:55,366 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:55,366 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:55:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:55:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:55:55,367 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:55:55,368 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,368 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:55,368 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,369 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:55,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:55:55,370 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:55:55,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@123599da[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:55,370 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,371 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,371 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:55:55,371 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:55:55,371 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,371 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:55,371 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:55:55,374 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:55:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:55,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:55:55,377 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:55:55,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:55,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:55,377 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,377 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:55,379 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,379 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,379 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:55,379 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,381 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,382 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,382 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:55,382 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:55,383 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:55,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:55,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:55,383 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:55,483 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:55,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:55,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,490 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:55,490 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:55,490 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:55,490 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:55,491 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,491 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,492 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,492 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:55,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:55,492 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:55,492 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:55:55,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:55,494 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:55,494 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:55,494 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 10:55:55,905 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289f826a623e6945f6875387b4b59b0352 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289f826a623e6945f6875387b4b59b0352 2023-03-14 10:55:56,309 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/23464b3560fb4e5fa523e5748157aa5d 2023-03-14 10:55:56,314 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/23464b3560fb4e5fa523e5748157aa5d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d 2023-03-14 10:55:56,317 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 10:55:56,318 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 824ms, sequenceid=9, compaction requested=false 2023-03-14 10:55:56,318 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:56,318 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:56,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:55:56,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:55:56,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:55:56,318 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:55:56,321 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:56,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:56,321 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:55:56,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79a76659[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:56,322 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:55:56,323 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,324 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:55:56,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:55:56,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:56,324 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,324 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:56,325 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:55:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:56,325 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:55:56,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:56,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:55:56,327 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:55:56,327 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:56,327 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:56,327 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,327 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:56,329 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,329 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:56,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,329 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:56,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:56,330 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,331 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:56,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:55:56,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:56,334 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:56,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:56,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,335 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,435 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:56,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:56,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,441 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:56,441 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:56,441 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:56,441 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:56,441 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,441 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,450 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,450 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:56,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:56,451 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:56,451 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,451 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,452 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:55:56,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:56,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:56,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:56,452 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:55:56,862 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012bda2672146241faa1e6107458fe24b2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012bda2672146241faa1e6107458fe24b2 2023-03-14 10:55:57,267 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/bd1a485fe6c44086a5229a19a7241fab 2023-03-14 10:55:57,271 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/bd1a485fe6c44086a5229a19a7241fab as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab 2023-03-14 10:55:57,274 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 10:55:57,275 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 823ms, sequenceid=13, compaction requested=true 2023-03-14 10:55:57,275 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:57,275 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:55:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:55:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:55:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:55:57,277 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:57,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:55:57,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e767fd1[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:57,278 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:55:57,279 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,280 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:55:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:55:57,281 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:57,281 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,281 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:55:57,282 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:55:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:57,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:57,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:55:57,284 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:55:57,284 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:57,284 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:57,284 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,284 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:57,286 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,286 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,286 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:57,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,286 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:57,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:57,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:57,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,287 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:57,290 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:57,290 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:57,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,290 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:57,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:57,290 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:57,391 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:57,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:57,395 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:57,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,396 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:57,396 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:57,396 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:57,396 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:57,397 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,397 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,398 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,398 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:57,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:57,399 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:57,399 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:55:57,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:57,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:57,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:57,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:57,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:57,400 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:57,400 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:57,400 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:57,400 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:55:57,810 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205935f2ca937994339bac472e4a4436f3c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205935f2ca937994339bac472e4a4436f3c 2023-03-14 10:55:58,215 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/604c117933334737bbcc13340556a9fd 2023-03-14 10:55:58,218 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/604c117933334737bbcc13340556a9fd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd 2023-03-14 10:55:58,222 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 10:55:58,222 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 822ms, sequenceid=17, compaction requested=true 2023-03-14 10:55:58,223 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:58,223 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:58,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:55:58,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:55:58,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:55:58,223 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:55:58,224 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,224 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:58,225 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,225 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:58,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:55:58,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d304b10[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:58,226 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:55:58,226 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,227 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,227 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:55:58,227 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,227 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:58,227 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:55:58,227 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:58,229 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,229 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:55:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:58,229 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:58,229 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:55:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:58,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:58,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:58,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:58,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:55:58,231 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:55:58,231 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:58,231 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:58,231 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,231 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:58,233 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,233 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,234 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:58,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:58,234 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,235 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:58,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:58,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:58,238 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,238 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:58,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:58,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,239 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:58,239 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,239 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:58,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:58,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:58,339 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:58,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:58,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:58,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:58,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,345 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:58,345 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:58,345 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:58,345 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:58,345 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,345 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,347 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,347 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:58,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:58,347 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:58,347 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,348 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:58,349 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:58,349 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:58,349 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:55:58,759 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122871ce8194795c4b5cb4f0fb5ade1b3c78 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122871ce8194795c4b5cb4f0fb5ade1b3c78 2023-03-14 10:55:59,164 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28 2023-03-14 10:55:59,168 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28 2023-03-14 10:55:59,172 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 10:55:59,173 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 823ms, sequenceid=21, compaction requested=true 2023-03-14 10:55:59,173 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:55:59,173 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:55:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:55:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:55:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:55:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,175 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:55:59,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73f5e025[Count = 0] remaining members to acquire global barrier 2023-03-14 10:55:59,176 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:55:59,176 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,178 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,178 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:55:59,178 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,178 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:55:59,178 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:55:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:55:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:55:59,180 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:55:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:55:59,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:55:59,182 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:55:59,182 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:55:59,182 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:55:59,182 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,182 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:55:59,183 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,183 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,183 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:55:59,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:55:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,184 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:55:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:55:59,185 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:55:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:59,190 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:55:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:59,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:59,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,190 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:55:59,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:55:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:55:59,191 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:55:59,291 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:55:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:55:59,295 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:55:59,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:55:59,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,296 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:55:59,296 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:59,296 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:55:59,296 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:55:59,297 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,297 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,298 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,298 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:55:59,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:55:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:55:59,298 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:55:59,298 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,299 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:55:59,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:55:59,299 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:55:59,299 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:55:59,299 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:55:59,300 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:55:59,300 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:55:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:55:59,300 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:55:59,300 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:55:59,710 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e9f6868e9c48422cbb9a92137c893f6c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9f6868e9c48422cbb9a92137c893f6c 2023-03-14 10:55:59,867 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:56:00,115 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/b021129c1c2d49a5a640a5787c115508 2023-03-14 10:56:00,118 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/b021129c1c2d49a5a640a5787c115508 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508 2023-03-14 10:56:00,121 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 10:56:00,122 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 822ms, sequenceid=25, compaction requested=true 2023-03-14 10:56:00,122 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:00,122 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:00,122 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:56:00,122 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:56:00,122 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,122 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:56:00,122 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:56:00,124 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,124 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:00,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:56:00,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3122c5ac[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:00,125 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:56:00,125 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,126 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:56:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:56:00,127 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:00,129 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:56:00,129 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:00,129 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,129 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:56:00,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:56:00,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:00,130 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:56:00,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:00,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:00,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,130 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:00,131 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,131 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:00,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,131 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:00,131 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:00,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,132 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:00,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:00,134 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:00,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:00,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:56:00,134 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:00,135 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,135 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:00,135 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:00,135 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:00,135 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,235 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:00,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:00,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:00,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:00,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,241 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:00,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:00,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:56:00,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:56:00,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,241 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,242 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:00,242 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:00,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:00,243 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:00,243 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:56:00,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:56:00,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:00,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:56:00,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:56:00,244 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:00,244 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:00,244 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:56:00,244 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:56:00,654 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cea28af7e98643fa96ee10e56e52960f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101cea28af7e98643fa96ee10e56e52960f 2023-03-14 10:56:01,059 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/4ad419a0cbcb43698cfbab965f9c224e 2023-03-14 10:56:01,062 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/4ad419a0cbcb43698cfbab965f9c224e as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e 2023-03-14 10:56:01,065 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 10:56:01,066 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 822ms, sequenceid=29, compaction requested=true 2023-03-14 10:56:01,066 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:01,066 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:01,066 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:56:01,066 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:56:01,066 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,066 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:56:01,066 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:56:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,069 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:01,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:01,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:01,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:01,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:01,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:56:01,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c97acae[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:01,071 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:56:01,071 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,072 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:56:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:56:01,072 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,072 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:56:01,073 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:01,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:01,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:56:01,075 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:56:01,075 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:01,075 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:01,075 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,075 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:01,077 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,077 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:01,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,077 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:01,077 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:01,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:01,078 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,081 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,081 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:01,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:01,082 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:01,082 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:01,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:01,182 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:01,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:01,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:01,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:01,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,188 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:01,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:01,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:56:01,188 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:56:01,189 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,189 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,190 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:01,190 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:01,190 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:01,190 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,191 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:56:01,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:01,191 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:56:01,191 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:01,191 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:56:01,191 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:56:01,192 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:01,192 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:01,192 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:56:01,192 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:56:01,603 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103109e02b5b82f4d57ba25f8be8ac8ff70 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103109e02b5b82f4d57ba25f8be8ac8ff70 2023-03-14 10:56:02,007 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/48f36215d51d47e38b1586da78bbe57b 2023-03-14 10:56:02,011 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/48f36215d51d47e38b1586da78bbe57b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b 2023-03-14 10:56:02,014 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 10:56:02,015 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 823ms, sequenceid=33, compaction requested=true 2023-03-14 10:56:02,015 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:02,015 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:56:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:56:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:56:02,015 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:56:02,016 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,016 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,017 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:56:02,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b01ee7[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:02,018 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:56:02,018 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,020 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,020 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:56:02,020 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:56:02,020 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:02,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,020 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:56:02,022 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:56:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:02,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:56:02,024 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:56:02,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:02,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:02,024 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,024 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:02,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,026 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:02,026 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,027 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:02,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:02,033 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:02,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:02,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:02,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:02,033 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,034 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,034 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,133 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:02,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:02,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,139 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:02,139 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:02,139 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:56:02,139 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:56:02,140 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,140 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,141 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,141 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:02,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:02,142 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,142 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:56:02,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:56:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:56:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:56:02,143 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:02,143 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:02,143 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:56:02,143 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:56:02,555 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e0129700ce494fa5af322c9e3d50370c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907e0129700ce494fa5af322c9e3d50370c 2023-03-14 10:56:02,960 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/b4c2caeedea240e0b6aaed2be3d98790 2023-03-14 10:56:02,963 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/b4c2caeedea240e0b6aaed2be3d98790 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790 2023-03-14 10:56:02,966 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 10:56:02,967 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 824ms, sequenceid=37, compaction requested=true 2023-03-14 10:56:02,967 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:02,967 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:56:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:56:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:56:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:56:02,969 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,969 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,969 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,969 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:56:02,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f183a7c[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:02,971 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:56:02,971 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,972 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:56:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:56:02,972 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:02,972 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,972 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:02,974 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:02,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:56:02,977 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:56:02,977 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:02,977 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:02,977 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,977 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:02,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:02,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,978 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:02,979 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,979 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:02,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:56:02,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:02,982 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:02,981 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:02,981 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:02,982 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,982 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:02,982 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:02,982 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:02,982 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:02,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:03,082 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:03,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:03,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:03,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:03,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,088 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:03,088 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:03,088 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 10:56:03,088 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 10:56:03,088 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,088 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,090 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,090 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:03,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:03,090 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,090 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 10:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 10:56:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 10:56:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 10:56:03,091 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:03,091 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:03,091 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. started... 2023-03-14 10:56:03,091 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26af9fe197a28ba1491482613ddc1516 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 10:56:03,501 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202fb93698a9484bf4b8b6515187b2bb4b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202fb93698a9484bf4b8b6515187b2bb4b 2023-03-14 10:56:03,906 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/37e62f30a42d4390b3ace57cd08eefc7 2023-03-14 10:56:03,910 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/37e62f30a42d4390b3ace57cd08eefc7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7 2023-03-14 10:56:03,913 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 10:56:03,914 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26af9fe197a28ba1491482613ddc1516 in 823ms, sequenceid=41, compaction requested=true 2023-03-14 10:56:03,914 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:03,914 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 10:56:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 10:56:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 10:56:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 10:56:03,916 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,916 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:03,916 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,916 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 10:56:03,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b08396[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:03,917 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 10:56:03,918 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,919 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 10:56:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 10:56:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:03,919 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,919 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:03,921 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 10:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 10:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:03,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 10:56:03,923 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 10:56:03,923 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:03,923 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:03,923 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,923 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:03,925 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,925 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:03,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,925 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,925 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:03,926 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,929 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,930 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:03,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 10:56:03,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:03,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:03,930 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:03,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:04,030 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:04,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:04,032 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-14 10:56:04,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:56:04,034 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:56:04,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:56:04,035 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791964035 2023-03-14 10:56:04,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 10:56:04,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-14 10:56:04,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:04,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x1dcd5ae5 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:56:04,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67682c0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:56:04,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:04,864 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103331002fdfaf043f5b3f152442f5d064c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103331002fdfaf043f5b3f152442f5d064c 2023-03-14 10:56:04,865 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:04,877 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:56:04,879 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:56:04,884 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:56:04,886 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44550, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:56:04,893 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 first=Optional[r5] last=Optional[r6] 2023-03-14 10:56:04,894 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b91d8649e1d5426a9f7a7cc19f98fdc8}] 2023-03-14 10:56:04,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 for inclusion in 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-14 10:56:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:56:04,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:04,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f7n3iq343u7s8m2ivs34sa1d0b53cgli2q0che6n304411kec9j20t0mh4nv4enj/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 2023-03-14 10:56:04,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f7n3iq343u7s8m2ivs34sa1d0b53cgli2q0che6n304411kec9j20t0mh4nv4enj/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_ 2023-03-14 10:56:04,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f7n3iq343u7s8m2ivs34sa1d0b53cgli2q0che6n304411kec9j20t0mh4nv4enj/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 into 26af9fe197a28ba1491482613ddc1516/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_ - updating store file list. 2023-03-14 10:56:04,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_ into 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:04,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f7n3iq343u7s8m2ivs34sa1d0b53cgli2q0che6n304411kec9j20t0mh4nv4enj/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 into 26af9fe197a28ba1491482613ddc1516/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_) 2023-03-14 10:56:04,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f7n3iq343u7s8m2ivs34sa1d0b53cgli2q0che6n304411kec9j20t0mh4nv4enj/family1/b91d8649e1d5426a9f7a7cc19f98fdc8 2023-03-14 10:56:04,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 10:56:04,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 10:56:04,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 26af9fe197a28ba1491482613ddc1516/family1 is initiating minor compaction 2023-03-14 10:56:04,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d23d2b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:56:04,909 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 26af9fe197a28ba1491482613ddc1516/family1 in testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:04,910 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp, totalSize=49.7 K 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 23464b3560fb4e5fa523e5748157aa5d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting bd1a485fe6c44086a5229a19a7241fab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 604c117933334737bbcc13340556a9fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting f8528e1ce2dc4f4b9a1b9fddc8ed3e28, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b021129c1c2d49a5a640a5787c115508, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 4ad419a0cbcb43698cfbab965f9c224e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 48f36215d51d47e38b1586da78bbe57b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting b4c2caeedea240e0b6aaed2be3d98790, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 37e62f30a42d4390b3ace57cd08eefc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 10:56:04,910 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 10:56:04,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:04,912 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:04,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101cea28af7e98643fa96ee10e56e52960f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101cea28af7e98643fa96ee10e56e52960f 2023-03-14 10:56:04,914 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103109e02b5b82f4d57ba25f8be8ac8ff70 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103109e02b5b82f4d57ba25f8be8ac8ff70 2023-03-14 10:56:04,914 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-14 10:56:04,914 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-14 10:56:04,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:04,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:04,959 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 26af9fe197a28ba1491482613ddc1516#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-14 10:56:05,376 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f587e4f228e94180b9ee81e249bcf3cc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f587e4f228e94180b9ee81e249bcf3cc 2023-03-14 10:56:05,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:05,410 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3759ff4900b5419496e663106fc4f868 first=Optional[r1] last=Optional[r4] 2023-03-14 10:56:05,411 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3759ff4900b5419496e663106fc4f868}] 2023-03-14 10:56:05,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3759ff4900b5419496e663106fc4f868 for inclusion in 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:05,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-14 10:56:05,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:56:05,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:05,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/3759ff4900b5419496e663106fc4f868 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jifgfgmq6e3se2a0uqvgb2tfdbctdrlieebf5qs5u807o01tlb78fvejjsau3c38/family1/3759ff4900b5419496e663106fc4f868 2023-03-14 10:56:05,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jifgfgmq6e3se2a0uqvgb2tfdbctdrlieebf5qs5u807o01tlb78fvejjsau3c38/family1/3759ff4900b5419496e663106fc4f868 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_ 2023-03-14 10:56:05,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jifgfgmq6e3se2a0uqvgb2tfdbctdrlieebf5qs5u807o01tlb78fvejjsau3c38/family1/3759ff4900b5419496e663106fc4f868 into 26af9fe197a28ba1491482613ddc1516/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_ - updating store file list. 2023-03-14 10:56:05,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_ into 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:05,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jifgfgmq6e3se2a0uqvgb2tfdbctdrlieebf5qs5u807o01tlb78fvejjsau3c38/family1/3759ff4900b5419496e663106fc4f868 into 26af9fe197a28ba1491482613ddc1516/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_) 2023-03-14 10:56:05,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jifgfgmq6e3se2a0uqvgb2tfdbctdrlieebf5qs5u807o01tlb78fvejjsau3c38/family1/3759ff4900b5419496e663106fc4f868 2023-03-14 10:56:05,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:05,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:05,426 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012bda2672146241faa1e6107458fe24b2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012bda2672146241faa1e6107458fe24b2 2023-03-14 10:56:05,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205935f2ca937994339bac472e4a4436f3c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205935f2ca937994339bac472e4a4436f3c 2023-03-14 10:56:05,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122871ce8194795c4b5cb4f0fb5ade1b3c78 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122871ce8194795c4b5cb4f0fb5ade1b3c78 2023-03-14 10:56:05,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9f6868e9c48422cbb9a92137c893f6c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e9f6868e9c48422cbb9a92137c893f6c 2023-03-14 10:56:05,429 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-14 10:56:05,429 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-14 10:56:05,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:05,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:05,771 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/8f1d635390084bd8b10cb0e83ac77c32 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/8f1d635390084bd8b10cb0e83ac77c32 2023-03-14 10:56:05,775 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 26af9fe197a28ba1491482613ddc1516/family1 of 26af9fe197a28ba1491482613ddc1516 into 8f1d635390084bd8b10cb0e83ac77c32(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:56:05,775 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:05,775 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678791364909; duration=0sec 2023-03-14 10:56:05,775 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:56:05,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_] to archive 2023-03-14 10:56:05,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:05,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/23464b3560fb4e5fa523e5748157aa5d 2023-03-14 10:56:05,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/bd1a485fe6c44086a5229a19a7241fab 2023-03-14 10:56:05,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/604c117933334737bbcc13340556a9fd 2023-03-14 10:56:05,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/f8528e1ce2dc4f4b9a1b9fddc8ed3e28 2023-03-14 10:56:05,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b021129c1c2d49a5a640a5787c115508 2023-03-14 10:56:05,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/4ad419a0cbcb43698cfbab965f9c224e 2023-03-14 10:56:05,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/48f36215d51d47e38b1586da78bbe57b 2023-03-14 10:56:05,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/b4c2caeedea240e0b6aaed2be3d98790 2023-03-14 10:56:05,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/37e62f30a42d4390b3ace57cd08eefc7 2023-03-14 10:56:05,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/fd5fd6edffd94141b846bbd33319b0ec_SeqId_44_ 2023-03-14 10:56:06,269 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130784c744262184adeaaae440541c392b4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130784c744262184adeaaae440541c392b4 2023-03-14 10:56:06,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:06,298 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c0fb862937bd4cfebbecfdc86cf20c09 first=Optional[r00] last=Optional[r8] 2023-03-14 10:56:06,299 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c0fb862937bd4cfebbecfdc86cf20c09}] 2023-03-14 10:56:06,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c0fb862937bd4cfebbecfdc86cf20c09 for inclusion in 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-14 10:56:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 10:56:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c0fb862937bd4cfebbecfdc86cf20c09 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p17nblirltv567knbiacvcif5o7q5khpikd7tpe7ce7t9ed1idikvv0a1lq24os0/family1/c0fb862937bd4cfebbecfdc86cf20c09 2023-03-14 10:56:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p17nblirltv567knbiacvcif5o7q5khpikd7tpe7ce7t9ed1idikvv0a1lq24os0/family1/c0fb862937bd4cfebbecfdc86cf20c09 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_ 2023-03-14 10:56:06,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p17nblirltv567knbiacvcif5o7q5khpikd7tpe7ce7t9ed1idikvv0a1lq24os0/family1/c0fb862937bd4cfebbecfdc86cf20c09 into 26af9fe197a28ba1491482613ddc1516/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_ - updating store file list. 2023-03-14 10:56:06,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_ into 26af9fe197a28ba1491482613ddc1516/family1 2023-03-14 10:56:06,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p17nblirltv567knbiacvcif5o7q5khpikd7tpe7ce7t9ed1idikvv0a1lq24os0/family1/c0fb862937bd4cfebbecfdc86cf20c09 into 26af9fe197a28ba1491482613ddc1516/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_) 2023-03-14 10:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p17nblirltv567knbiacvcif5o7q5khpikd7tpe7ce7t9ed1idikvv0a1lq24os0/family1/c0fb862937bd4cfebbecfdc86cf20c09 2023-03-14 10:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 10:56:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 10:56:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(1912): 26af9fe197a28ba1491482613ddc1516/family1 is initiating minor compaction (all files) 2023-03-14 10:56:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3090a2c3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:56:06,312 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 26af9fe197a28ba1491482613ddc1516/family1 in testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:06,312 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/8f1d635390084bd8b10cb0e83ac77c32, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp, totalSize=344.3 K 2023-03-14 10:56:06,313 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 0e421bc1fbb34339a03e11626ac1d257, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878837821 2023-03-14 10:56:06,313 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 8f1d635390084bd8b10cb0e83ac77c32, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621237821 2023-03-14 10:56:06,313 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965237821 2023-03-14 10:56:06,314 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:06,314 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] compactions.Compactor(207): Compacting 1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014837821 2023-03-14 10:56:06,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:06,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202fb93698a9484bf4b8b6515187b2bb4b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511202fb93698a9484bf4b8b6515187b2bb4b 2023-03-14 10:56:06,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289f826a623e6945f6875387b4b59b0352 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289f826a623e6945f6875387b4b59b0352 2023-03-14 10:56:06,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130fa900aa7456c48a1a23522d44d05cf6e to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130fa900aa7456c48a1a23522d44d05cf6e 2023-03-14 10:56:06,320 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-14 10:56:06,320 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 10:56:06,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:06,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:06,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 10:56:06,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 10:56:06,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:56:06,323 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 10:56:06,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2900 sec 2023-03-14 10:56:06,331 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] throttle.PressureAwareThroughputController(145): 26af9fe197a28ba1491482613ddc1516#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-03-14 10:56:06,526 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=259 (was 248) - Thread LEAK? -, OpenFileDescriptor=646 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 172), ProcessCount=169 (was 169), AvailableMemoryMB=2666 (was 2674) 2023-03-14 10:56:06,539 INFO [Listener at localhost/44023] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=259, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=169, AvailableMemoryMB=2666 2023-03-14 10:56:06,559 DEBUG [Listener at localhost/44023] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-14 10:56:06,613 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFA{\xD3\xE2\xFC\xF24h;\xFB}1\x117p\x7F"\x10\x91\x9A,\x1D7b\x0E\xF2\x8B\xF5k4>\x04\x13\xB3*\x10_\xBEx\x94\x02%>\xCB<\xE8h\x97\x1F\xFDN\xB22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 10:56:06,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-14 10:56:06,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 10:56:06,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-14 10:56:06,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 10:56:06,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:06,618 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:06,618 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:06,618 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048 empty. 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45 empty. 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd empty. 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:06,619 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:06,619 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-14 10:56:06,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:06,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:07,026 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-14 10:56:07,028 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 38d9722c1649f1b2cbaf2182ec144b45, NAME => 'testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFA{\xD3\xE2\xFC\xF24h;\xFB}1\x117p\x7F"\x10\x91\x9A,\x1D7b\x0E\xF2\x8B\xF5k4>\x04\x13\xB3*\x10_\xBEx\x94\x02%>\xCB<\xE8h\x97\x1F\xFDN\xB22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:56:07,028 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f056af8a677fcc6cb73d04f9b2cc0dd, NAME => 'testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFA{\xD3\xE2\xFC\xF24h;\xFB}1\x117p\x7F"\x10\x91\x9A,\x1D7b\x0E\xF2\x8B\xF5k4>\x04\x13\xB3*\x10_\xBEx\x94\x02%>\xCB<\xE8h\x97\x1F\xFDN\xB22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:56:07,028 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => f38e879bf9fc0af71ad43873a237e048, NAME => 'testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFA{\xD3\xE2\xFC\xF24h;\xFB}1\x117p\x7F"\x10\x91\x9A,\x1D7b\x0E\xF2\x8B\xF5k4>\x04\x13\xB3*\x10_\xBEx\x94\x02%>\xCB<\xE8h\x97\x1F\xFDN\xB22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/.tmp 2023-03-14 10:56:07,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 38d9722c1649f1b2cbaf2182ec144b45, disabling compactions & flushes 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing f38e879bf9fc0af71ad43873a237e048, disabling compactions & flushes 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 5f056af8a677fcc6cb73d04f9b2cc0dd, disabling compactions & flushes 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. after waiting 0 ms 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. after waiting 0 ms 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. after waiting 0 ms 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:07,435 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,435 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:07,437 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 10:56:07,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678791367438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791367438"}]},"ts":"1678791367438"} 2023-03-14 10:56:07,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791367438"}]},"ts":"1678791367438"} 2023-03-14 10:56:07,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678791367438"}]},"ts":"1678791367438"} 2023-03-14 10:56:07,440 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 10:56:07,441 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 10:56:07,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791367441"}]},"ts":"1678791367441"} 2023-03-14 10:56:07,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-14 10:56:07,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f38e879bf9fc0af71ad43873a237e048, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f056af8a677fcc6cb73d04f9b2cc0dd, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d9722c1649f1b2cbaf2182ec144b45, ASSIGN}] 2023-03-14 10:56:07,446 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f38e879bf9fc0af71ad43873a237e048, ASSIGN 2023-03-14 10:56:07,446 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f056af8a677fcc6cb73d04f9b2cc0dd, ASSIGN 2023-03-14 10:56:07,446 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d9722c1649f1b2cbaf2182ec144b45, ASSIGN 2023-03-14 10:56:07,447 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f056af8a677fcc6cb73d04f9b2cc0dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:56:07,447 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d9722c1649f1b2cbaf2182ec144b45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:56:07,447 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f38e879bf9fc0af71ad43873a237e048, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36455,1678791214611; forceNewPlan=false, retain=false 2023-03-14 10:56:07,553 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/.tmp/family1/dddd12f1debc4cadbe2c596efa5e66db as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/dddd12f1debc4cadbe2c596efa5e66db 2023-03-14 10:56:07,557 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 26af9fe197a28ba1491482613ddc1516/family1 of 26af9fe197a28ba1491482613ddc1516 into dddd12f1debc4cadbe2c596efa5e66db(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:56:07,557 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:07,557 INFO [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1678791366312; duration=1sec 2023-03-14 10:56:07,557 DEBUG [RS:0;jenkins-hbase4:36455-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 10:56:07,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5f056af8a677fcc6cb73d04f9b2cc0dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=38d9722c1649f1b2cbaf2182ec144b45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,599 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=f38e879bf9fc0af71ad43873a237e048, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678791367599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791367599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791367599"}]},"ts":"1678791367599"} 2023-03-14 10:56:07,599 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791367599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791367599"}]},"ts":"1678791367599"} 2023-03-14 10:56:07,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1678791367599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678791367599"}]},"ts":"1678791367599"} 2023-03-14 10:56:07,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 5f056af8a677fcc6cb73d04f9b2cc0dd, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:56:07,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure f38e879bf9fc0af71ad43873a237e048, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:56:07,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 38d9722c1649f1b2cbaf2182ec144b45, server=jenkins-hbase4.apache.org,36455,1678791214611}] 2023-03-14 10:56:07,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/8f1d635390084bd8b10cb0e83ac77c32, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_] to archive 2023-03-14 10:56:07,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:07,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/0e421bc1fbb34339a03e11626ac1d257 2023-03-14 10:56:07,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/8f1d635390084bd8b10cb0e83ac77c32 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/8f1d635390084bd8b10cb0e83ac77c32 2023-03-14 10:56:07,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/16a8ff2e4b27471aa4735e4e473cc0c6_SeqId_46_ 2023-03-14 10:56:07,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_ to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/family1/1b8d84234e9f4f58851599c0ad17be7d_SeqId_49_ 2023-03-14 10:56:07,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:07,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f056af8a677fcc6cb73d04f9b2cc0dd, NAME => 'testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 10:56:07,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,776 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,778 DEBUG [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1 2023-03-14 10:56:07,778 DEBUG [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1 2023-03-14 10:56:07,778 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f056af8a677fcc6cb73d04f9b2cc0dd columnFamilyName family1 2023-03-14 10:56:07,779 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] regionserver.HStore(310): Store=5f056af8a677fcc6cb73d04f9b2cc0dd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,779 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,780 DEBUG [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2 2023-03-14 10:56:07,780 DEBUG [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2 2023-03-14 10:56:07,781 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f056af8a677fcc6cb73d04f9b2cc0dd columnFamilyName family2 2023-03-14 10:56:07,781 INFO [StoreOpener-5f056af8a677fcc6cb73d04f9b2cc0dd-1] regionserver.HStore(310): Store=5f056af8a677fcc6cb73d04f9b2cc0dd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:56:07,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:07,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:56:07,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f056af8a677fcc6cb73d04f9b2cc0dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62705710, jitterRate=-0.06561210751533508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:56:07,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:07,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd., pid=120, masterSystemTime=1678791367752 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:07,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f38e879bf9fc0af71ad43873a237e048, NAME => 'testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 10:56:07,789 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5f056af8a677fcc6cb73d04f9b2cc0dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,789 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678791367789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791367789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791367789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791367789"}]},"ts":"1678791367789"} 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-03-14 10:56:07,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 5f056af8a677fcc6cb73d04f9b2cc0dd, server=jenkins-hbase4.apache.org,36455,1678791214611 in 190 msec 2023-03-14 10:56:07,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5f056af8a677fcc6cb73d04f9b2cc0dd, ASSIGN in 347 msec 2023-03-14 10:56:07,810 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,811 DEBUG [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1 2023-03-14 10:56:07,811 DEBUG [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1 2023-03-14 10:56:07,812 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38e879bf9fc0af71ad43873a237e048 columnFamilyName family1 2023-03-14 10:56:07,812 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] regionserver.HStore(310): Store=f38e879bf9fc0af71ad43873a237e048/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,813 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,813 DEBUG [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2 2023-03-14 10:56:07,813 DEBUG [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2 2023-03-14 10:56:07,814 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f38e879bf9fc0af71ad43873a237e048 columnFamilyName family2 2023-03-14 10:56:07,814 INFO [StoreOpener-f38e879bf9fc0af71ad43873a237e048-1] regionserver.HStore(310): Store=f38e879bf9fc0af71ad43873a237e048/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:56:07,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:07,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:56:07,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f38e879bf9fc0af71ad43873a237e048; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69873535, jitterRate=0.041196808218955994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:56:07,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:07,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048., pid=121, masterSystemTime=1678791367752 2023-03-14 10:56:07,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:07,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38d9722c1649f1b2cbaf2182ec144b45, NAME => 'testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 10:56:07,821 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=f38e879bf9fc0af71ad43873a237e048, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 10:56:07,821 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367821"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791367821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791367821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791367821"}]},"ts":"1678791367821"} 2023-03-14 10:56:07,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-03-14 10:56:07,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure f38e879bf9fc0af71ad43873a237e048, server=jenkins-hbase4.apache.org,36455,1678791214611 in 222 msec 2023-03-14 10:56:07,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=f38e879bf9fc0af71ad43873a237e048, ASSIGN in 379 msec 2023-03-14 10:56:07,842 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,844 DEBUG [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1 2023-03-14 10:56:07,844 DEBUG [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1 2023-03-14 10:56:07,844 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38d9722c1649f1b2cbaf2182ec144b45 columnFamilyName family1 2023-03-14 10:56:07,845 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] regionserver.HStore(310): Store=38d9722c1649f1b2cbaf2182ec144b45/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,845 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,846 DEBUG [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2 2023-03-14 10:56:07,846 DEBUG [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2 2023-03-14 10:56:07,846 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38d9722c1649f1b2cbaf2182ec144b45 columnFamilyName family2 2023-03-14 10:56:07,847 INFO [StoreOpener-38d9722c1649f1b2cbaf2182ec144b45-1] regionserver.HStore(310): Store=38d9722c1649f1b2cbaf2182ec144b45/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 10:56:07,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 10:56:07,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:07,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 10:56:07,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 38d9722c1649f1b2cbaf2182ec144b45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70487069, jitterRate=0.05033917725086212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 10:56:07,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:07,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45., pid=122, masterSystemTime=1678791367752 2023-03-14 10:56:07,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:07,853 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=38d9722c1649f1b2cbaf2182ec144b45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:07,853 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678791367853"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1678791367853"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678791367853"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678791367853"}]},"ts":"1678791367853"} 2023-03-14 10:56:07,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-03-14 10:56:07,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 38d9722c1649f1b2cbaf2182ec144b45, server=jenkins-hbase4.apache.org,36455,1678791214611 in 253 msec 2023-03-14 10:56:07,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-03-14 10:56:07,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38d9722c1649f1b2cbaf2182ec144b45, ASSIGN in 410 msec 2023-03-14 10:56:07,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 10:56:07,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678791367857"}]},"ts":"1678791367857"} 2023-03-14 10:56:07,858 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-14 10:56:07,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 10:56:07,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2470 sec 2023-03-14 10:56:08,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 10:56:08,721 INFO [Listener at localhost/44023] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-14 10:56:08,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:08,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:08,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:08,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 10:56:08,732 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 10:56:08,732 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:08,732 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 10:56:08,732 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 10:56:08,732 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:08,732 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:08,734 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:08,734 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:08,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:08,734 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:08,734 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:08,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:08,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 10:56:08,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 10:56:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 10:56:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 10:56:08,736 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:08,736 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. started... 2023-03-14 10:56:08,736 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:08,736 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. started... 2023-03-14 10:56:08,736 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:56:08,736 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:08,736 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:08,736 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5f056af8a677fcc6cb73d04f9b2cc0dd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:56:08,737 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 38d9722c1649f1b2cbaf2182ec144b45 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:56:08,737 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. started... 2023-03-14 10:56:08,738 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f38e879bf9fc0af71ad43873a237e048 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 10:56:08,786 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314e571aed9d2654d22a52dda7f152e6151 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314e571aed9d2654d22a52dda7f152e6151 2023-03-14 10:56:08,792 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031480c4c645d32447cd8e7aa2cf519efcc0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031480c4c645d32447cd8e7aa2cf519efcc0 2023-03-14 10:56:09,181 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303148b3d3ae999a44c13954c9d5d231de7e5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148b3d3ae999a44c13954c9d5d231de7e5 2023-03-14 10:56:09,208 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/4874b080fbb343349b01cf981f914a9b 2023-03-14 10:56:09,214 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/00cbdb3f610548c4b95ac976838fba36 2023-03-14 10:56:09,246 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031430d7fb201c61434fbbf0d6a01f153620 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023031430d7fb201c61434fbbf0d6a01f153620 2023-03-14 10:56:09,250 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/6e3db70ad7064fd1977ee7a54f1cddc2 2023-03-14 10:56:09,253 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/00cbdb3f610548c4b95ac976838fba36 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36 2023-03-14 10:56:09,277 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 10:56:09,277 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/6e3db70ad7064fd1977ee7a54f1cddc2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2 2023-03-14 10:56:09,280 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:56:09,281 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 38d9722c1649f1b2cbaf2182ec144b45 in 544ms, sequenceid=5, compaction requested=false 2023-03-14 10:56:09,281 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-14 10:56:09,281 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:09,282 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:09,282 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:56:09,596 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/09d2f6a91c4644b385477778b56af6de 2023-03-14 10:56:09,640 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031435666d32a03145a1adc55146540f4a67 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023031435666d32a03145a1adc55146540f4a67 2023-03-14 10:56:10,028 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031482eb23b92a2d428688b9687f6f82336c to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031482eb23b92a2d428688b9687f6f82336c 2023-03-14 10:56:10,045 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/32250ba9f6784ebda67c07b340d10dd5 2023-03-14 10:56:10,048 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/4874b080fbb343349b01cf981f914a9b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b 2023-03-14 10:56:10,071 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 10:56:10,072 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/32250ba9f6784ebda67c07b340d10dd5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5 2023-03-14 10:56:10,075 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:56:10,076 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5f056af8a677fcc6cb73d04f9b2cc0dd in 1340ms, sequenceid=5, compaction requested=false 2023-03-14 10:56:10,077 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:10,077 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:10,077 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:56:10,433 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/e754376082e240f2a76a5152c38f715d 2023-03-14 10:56:10,436 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/09d2f6a91c4644b385477778b56af6de as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de 2023-03-14 10:56:10,459 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 10:56:10,459 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/e754376082e240f2a76a5152c38f715d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d 2023-03-14 10:56:10,463 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 10:56:10,464 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f38e879bf9fc0af71ad43873a237e048 in 1726ms, sequenceid=5, compaction requested=false 2023-03-14 10:56:10,464 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:10,464 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:56:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:56:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 10:56:10,464 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 10:56:10,468 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,468 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:10,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:10,468 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,468 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:10,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 10:56:10,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@973aaf2[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:10,470 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 10:56:10,470 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,471 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 10:56:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 10:56:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:10,471 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,471 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:10,474 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,474 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:10,474 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:10,474 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:10,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 10:56:10,476 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 10:56:10,476 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:10,476 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:10,476 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 10:56:10,476 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:10,477 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,477 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:10,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,477 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:10,477 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:10,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,478 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:10,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:10,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,480 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:10,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 10:56:10,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:10,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 10:56:10,481 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:10,481 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:10,481 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:10,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:10,581 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:10,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:10,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:10,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:10,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:10,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 10:56:10,587 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 10:56:10,587 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:10,587 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 10:56:10,587 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 10:56:10,588 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,588 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:10,589 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,589 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:10,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:10,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:10,589 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:10,589 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:10,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:10,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:10,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:10,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:10,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 10:56:10,590 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 10:56:10,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 10:56:10,590 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 10:56:10,590 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:10,590 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 10:56:10,590 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:10,591 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. started... 2023-03-14 10:56:10,591 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:10,591 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:10,591 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. started... 2023-03-14 10:56:10,591 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:56:10,591 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:10,591 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5f056af8a677fcc6cb73d04f9b2cc0dd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:56:10,591 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. started... 2023-03-14 10:56:10,591 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f38e879bf9fc0af71ad43873a237e048 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:56:10,591 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 38d9722c1649f1b2cbaf2182ec144b45 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 10:56:10,639 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d765a13ce47d41dab6b3958640e2afc2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314d765a13ce47d41dab6b3958640e2afc2 2023-03-14 10:56:10,639 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314b8d626492fc844af8e1b616258afbeea to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b8d626492fc844af8e1b616258afbeea 2023-03-14 10:56:11,038 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031421da0846f4f54ba082de0358125873f5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031421da0846f4f54ba082de0358125873f5 2023-03-14 10:56:11,053 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/48c02a03e5ae45bc863d4214a6c389f2 2023-03-14 10:56:11,060 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/cc09c3cea9044e3fa7d161a0c7037561 2023-03-14 10:56:11,453 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/dcf34ce5ab5e41adbe4a127903d5a088 2023-03-14 10:56:11,485 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314016ba0e057224045b55b72771a691503 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230314016ba0e057224045b55b72771a691503 2023-03-14 10:56:11,491 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144a9c3890c4e34ea6a999d5c70c186a1f to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303144a9c3890c4e34ea6a999d5c70c186a1f 2023-03-14 10:56:11,887 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314e379d384b346411da1887c94fc187e61 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230314e379d384b346411da1887c94fc187e61 2023-03-14 10:56:11,889 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/837d8029725749f4a609396ad2d6db5a 2023-03-14 10:56:11,893 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/48c02a03e5ae45bc863d4214a6c389f2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2 2023-03-14 10:56:11,895 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/2278db884c4f41cda80e63e0b6465489 2023-03-14 10:56:11,898 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/cc09c3cea9044e3fa7d161a0c7037561 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561 2023-03-14 10:56:11,916 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 10:56:11,916 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/837d8029725749f4a609396ad2d6db5a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a 2023-03-14 10:56:11,919 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:56:11,920 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f38e879bf9fc0af71ad43873a237e048 in 1329ms, sequenceid=9, compaction requested=false 2023-03-14 10:56:11,920 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:11,920 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:56:11,920 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 10:56:11,921 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/2278db884c4f41cda80e63e0b6465489 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489 2023-03-14 10:56:11,924 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:56:11,924 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5f056af8a677fcc6cb73d04f9b2cc0dd in 1333ms, sequenceid=9, compaction requested=false 2023-03-14 10:56:11,925 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:11,925 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:11,925 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:56:12,291 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/3e4aa2bed9454e4c902e88c066975638 2023-03-14 10:56:12,295 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/dcf34ce5ab5e41adbe4a127903d5a088 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088 2023-03-14 10:56:12,318 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 10:56:12,319 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/3e4aa2bed9454e4c902e88c066975638 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638 2023-03-14 10:56:12,323 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 10:56:12,324 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 38d9722c1649f1b2cbaf2182ec144b45 in 1733ms, sequenceid=9, compaction requested=false 2023-03-14 10:56:12,324 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:12,324 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:12,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:56:12,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:56:12,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 10:56:12,324 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 10:56:12,326 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,326 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:12,327 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,327 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:12,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 10:56:12,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a77ca1d[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:12,328 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 10:56:12,328 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,329 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,329 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 10:56:12,329 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,329 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:12,329 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 10:56:12,329 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:12,331 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,331 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 10:56:12,331 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,331 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 10:56:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:12,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 10:56:12,333 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 10:56:12,333 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:12,333 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:12,333 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 10:56:12,333 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:12,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,334 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:12,335 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:12,336 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:12,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 10:56:12,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:12,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:12,338 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:12,338 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 10:56:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:12,339 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:12,339 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:12,339 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,339 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:12,339 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:12,439 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:12,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:12,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:12,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:12,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:12,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:12,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:12,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 10:56:12,446 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 10:56:12,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:12,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 10:56:12,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 10:56:12,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,446 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:12,448 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,448 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:12,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:12,448 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:12,448 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:12,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:12,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 10:56:12,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 10:56:12,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 10:56:12,449 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 10:56:12,449 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:12,449 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 10:56:12,450 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:12,450 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. started... 2023-03-14 10:56:12,450 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5f056af8a677fcc6cb73d04f9b2cc0dd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:56:12,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:12,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. started... 2023-03-14 10:56:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:56:12,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:12,452 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 38d9722c1649f1b2cbaf2182ec144b45 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:56:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:12,452 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. started... 2023-03-14 10:56:12,452 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f38e879bf9fc0af71ad43873a237e048 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 10:56:12,510 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314812294acfab04872a94a297693920dad to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314812294acfab04872a94a297693920dad 2023-03-14 10:56:12,510 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314b82232255bce45e78b3f96d66f8d3563 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b82232255bce45e78b3f96d66f8d3563 2023-03-14 10:56:12,530 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/7ed96989fe014f83aecc190177fddc15 2023-03-14 10:56:12,558 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:56:12,558 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dcd5ae5 to 127.0.0.1:58692 2023-03-14 10:56:12,558 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:12,559 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:56:12,559 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b16590 to 127.0.0.1:58692 2023-03-14 10:56:12,559 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:12,911 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303142068f34a5d584cbd9f6ff708a723c0de to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303142068f34a5d584cbd9f6ff708a723c0de 2023-03-14 10:56:12,929 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/c9d08ffa628e42f4984a20e26d9a0bcd 2023-03-14 10:56:12,985 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031487a15034207f4daa95912d3dacf511d8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031487a15034207f4daa95912d3dacf511d8 2023-03-14 10:56:13,291 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 10:56:13,326 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/6067358f12c84072b8677a68c2a389b7 2023-03-14 10:56:13,361 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303147a02dcd85a024081b6c417c1cbf05f19 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303147a02dcd85a024081b6c417c1cbf05f19 2023-03-14 10:56:13,361 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303148fd79a469a6049369288593181c46b92 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303148fd79a469a6049369288593181c46b92 2023-03-14 10:56:13,390 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/13aa324a8486444b9101ebf5887910d7 2023-03-14 10:56:13,393 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/7ed96989fe014f83aecc190177fddc15 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15 2023-03-14 10:56:13,416 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 10:56:13,416 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/13aa324a8486444b9101ebf5887910d7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7 2023-03-14 10:56:13,419 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:56:13,420 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f38e879bf9fc0af71ad43873a237e048 in 968ms, sequenceid=13, compaction requested=true 2023-03-14 10:56:13,420 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:13,420 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:13,420 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:56:13,766 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/658aea422abe4fe49a5a3e35d7f62d60 2023-03-14 10:56:13,766 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/513a12bfb7204960a2462c37e43fb5cc 2023-03-14 10:56:13,770 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/c9d08ffa628e42f4984a20e26d9a0bcd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd 2023-03-14 10:56:13,770 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/6067358f12c84072b8677a68c2a389b7 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7 2023-03-14 10:56:13,793 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 10:56:13,794 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/513a12bfb7204960a2462c37e43fb5cc as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc 2023-03-14 10:56:13,797 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:56:13,798 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 38d9722c1649f1b2cbaf2182ec144b45 in 1346ms, sequenceid=13, compaction requested=true 2023-03-14 10:56:13,798 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:13,798 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:13,798 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:56:13,804 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 10:56:13,805 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/658aea422abe4fe49a5a3e35d7f62d60 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60 2023-03-14 10:56:13,808 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 10:56:13,809 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5f056af8a677fcc6cb73d04f9b2cc0dd in 1359ms, sequenceid=13, compaction requested=true 2023-03-14 10:56:13,809 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:13,809 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:13,809 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:56:13,809 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:56:13,809 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,809 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 10:56:13,810 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 10:56:13,812 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,812 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 10:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e2d2f5[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:13,814 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 10:56:13,814 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,815 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 10:56:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 10:56:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:13,815 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,815 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:13,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 10:56:13,816 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,816 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 10:56:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 10:56:13,818 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 10:56:13,818 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:13,818 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:13,819 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 10:56:13,819 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:13,820 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,820 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,820 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:13,820 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,822 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,824 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,824 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:13,824 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:13,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:13,825 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:13,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 10:56:13,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 10:56:13,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:13,824 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:13,824 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:13,825 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,925 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:13,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:13,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:13,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:13,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 10:56:13,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:13,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:13,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 10:56:13,932 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 10:56:13,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:13,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 10:56:13,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 10:56:13,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,932 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:13,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,936 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:13,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:13,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:13,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:13,936 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:13,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:13,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:13,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:13,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:13,937 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 10:56:13,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 10:56:13,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 10:56:13,937 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 10:56:13,937 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:13,937 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 10:56:13,937 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:13,937 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:56:13,938 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:13,938 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. started... 2023-03-14 10:56:13,937 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:13,938 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:13,937 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. started... 2023-03-14 10:56:13,938 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f38e879bf9fc0af71ad43873a237e048 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:56:13,938 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. started... 2023-03-14 10:56:13,938 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5f056af8a677fcc6cb73d04f9b2cc0dd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:56:13,938 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 38d9722c1649f1b2cbaf2182ec144b45 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 10:56:13,984 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303140f71c1ac6b8a42db97ffd62401d2abbd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303140f71c1ac6b8a42db97ffd62401d2abbd 2023-03-14 10:56:13,984 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144b3fd318ae0e4ee890491e5f9efe3290 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303144b3fd318ae0e4ee890491e5f9efe3290 2023-03-14 10:56:14,001 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314f69da7998b0a489494f2c4c78a173268 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314f69da7998b0a489494f2c4c78a173268 2023-03-14 10:56:14,008 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/ff05789509414c1da0e9e94b2c92406a 2023-03-14 10:56:14,008 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/9bf6d75534fb4f399cdfdf6199737cf1 2023-03-14 10:56:14,021 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/7cf2349fffcb48b5a606e4db125ad6b2 2023-03-14 10:56:14,053 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314fa69adaa61484b248a0ef4fbfb2198ba to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230314fa69adaa61484b248a0ef4fbfb2198ba 2023-03-14 10:56:14,060 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/a02e703be5624552a45e30370ee86067 2023-03-14 10:56:14,063 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/ff05789509414c1da0e9e94b2c92406a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a 2023-03-14 10:56:14,087 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 10:56:14,088 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/a02e703be5624552a45e30370ee86067 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067 2023-03-14 10:56:14,091 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:56:14,092 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5f056af8a677fcc6cb73d04f9b2cc0dd in 154ms, sequenceid=17, compaction requested=true 2023-03-14 10:56:14,092 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:14,092 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:14,092 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:56:14,453 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303149306a1959bed444b8e9df23a1187d893 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303149306a1959bed444b8e9df23a1187d893 2023-03-14 10:56:14,462 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314680192aa09574ae7a24cc737e07138c4 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230314680192aa09574ae7a24cc737e07138c4 2023-03-14 10:56:14,466 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/78eb5e0ba1954559a582c04c1840c1ed 2023-03-14 10:56:14,470 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/7cf2349fffcb48b5a606e4db125ad6b2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2 2023-03-14 10:56:14,494 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 10:56:14,495 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/78eb5e0ba1954559a582c04c1840c1ed as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed 2023-03-14 10:56:14,498 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:56:14,499 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f38e879bf9fc0af71ad43873a237e048 in 561ms, sequenceid=17, compaction requested=true 2023-03-14 10:56:14,499 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:14,499 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:14,499 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:56:14,858 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/c42baa2e92b44737a35d3433f8e4cc52 2023-03-14 10:56:14,862 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/9bf6d75534fb4f399cdfdf6199737cf1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1 2023-03-14 10:56:14,885 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 10:56:14,886 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/c42baa2e92b44737a35d3433f8e4cc52 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52 2023-03-14 10:56:14,889 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 10:56:14,890 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 38d9722c1649f1b2cbaf2182ec144b45 in 952ms, sequenceid=17, compaction requested=true 2023-03-14 10:56:14,890 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:14,890 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:14,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:56:14,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:56:14,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 10:56:14,890 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 10:56:14,891 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,892 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:14,892 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,892 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:14,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:14,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 10:56:14,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28f24fcc[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:14,893 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 10:56:14,893 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,895 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,895 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 10:56:14,895 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 10:56:14,895 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:14,895 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,895 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:14,897 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 10:56:14,897 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,897 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:14,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,897 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 10:56:14,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:14,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:14,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:14,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:14,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:14,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:14,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 10:56:14,899 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 10:56:14,899 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:14,899 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:14,899 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 10:56:14,899 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:14,900 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,900 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,900 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:14,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:14,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:14,901 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:14,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,902 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:14,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:14,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,904 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,904 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:14,904 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:14,904 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:14,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:14,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 10:56:14,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:14,904 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:14,904 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:14,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:14,905 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:14,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 10:56:14,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:14,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:15,005 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:15,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:15,014 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:15,023 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:15,031 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:15,032 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:15,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-14 10:56:15,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 10:56:15,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 10:56:15,126 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 10:56:15,126 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:15,126 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 10:56:15,126 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 10:56:15,126 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:15,127 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:15,129 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:15,129 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:15,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:15,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:15,130 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 10:56:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:15,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 10:56:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:15,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 10:56:15,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 10:56:15,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 10:56:15,131 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 10:56:15,131 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 10:56:15,131 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. started... 2023-03-14 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:15,132 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5f056af8a677fcc6cb73d04f9b2cc0dd 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:56:15,132 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. started... 2023-03-14 10:56:15,133 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 38d9722c1649f1b2cbaf2182ec144b45 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:56:15,134 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 10:56:15,134 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 10:56:15,134 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:15,134 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. started... 2023-03-14 10:56:15,134 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f38e879bf9fc0af71ad43873a237e048 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 10:56:15,599 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/2a63208897304d149d320dce486e6bcd 2023-03-14 10:56:15,599 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/123a637d926a47fe8eb8f0f6d8cf6dd9 2023-03-14 10:56:15,599 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/c7cbd8d7c9f74671a0e85d0357212dd8 2023-03-14 10:56:15,632 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7cbd8d7c9f74671a0e85d0357212dd8 2023-03-14 10:56:15,635 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a63208897304d149d320dce486e6bcd 2023-03-14 10:56:15,636 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 123a637d926a47fe8eb8f0f6d8cf6dd9 2023-03-14 10:56:16,087 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/a703668212514bae90c2fddfcb0f390d 2023-03-14 10:56:16,089 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a703668212514bae90c2fddfcb0f390d 2023-03-14 10:56:16,090 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/c7cbd8d7c9f74671a0e85d0357212dd8 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8 2023-03-14 10:56:16,116 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7cbd8d7c9f74671a0e85d0357212dd8 2023-03-14 10:56:16,116 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 10:56:16,116 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/a703668212514bae90c2fddfcb0f390d as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d 2023-03-14 10:56:16,119 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a703668212514bae90c2fddfcb0f390d 2023-03-14 10:56:16,119 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:56:16,120 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f38e879bf9fc0af71ad43873a237e048 in 986ms, sequenceid=23, compaction requested=true 2023-03-14 10:56:16,120 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:16,120 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:16,120 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 10:56:16,484 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/a3e0306105e24003b1a068014acd7045 2023-03-14 10:56:16,486 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/97e75fe59ec34a75b05816aa31482b60 2023-03-14 10:56:16,487 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3e0306105e24003b1a068014acd7045 2023-03-14 10:56:16,488 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/2a63208897304d149d320dce486e6bcd as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd 2023-03-14 10:56:16,489 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97e75fe59ec34a75b05816aa31482b60 2023-03-14 10:56:16,489 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/123a637d926a47fe8eb8f0f6d8cf6dd9 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9 2023-03-14 10:56:16,511 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a63208897304d149d320dce486e6bcd 2023-03-14 10:56:16,511 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 10:56:16,511 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/a3e0306105e24003b1a068014acd7045 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045 2023-03-14 10:56:16,514 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3e0306105e24003b1a068014acd7045 2023-03-14 10:56:16,515 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:56:16,515 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 38d9722c1649f1b2cbaf2182ec144b45 in 1383ms, sequenceid=23, compaction requested=true 2023-03-14 10:56:16,515 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:16,515 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:16,515 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 10:56:16,521 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 123a637d926a47fe8eb8f0f6d8cf6dd9 2023-03-14 10:56:16,521 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 10:56:16,522 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/97e75fe59ec34a75b05816aa31482b60 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60 2023-03-14 10:56:16,525 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97e75fe59ec34a75b05816aa31482b60 2023-03-14 10:56:16,525 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 10:56:16,526 INFO [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5f056af8a677fcc6cb73d04f9b2cc0dd in 1394ms, sequenceid=23, compaction requested=true 2023-03-14 10:56:16,526 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:16,526 DEBUG [rs(jenkins-hbase4.apache.org,36455,1678791214611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 10:56:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 10:56:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 10:56:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 10:56:16,528 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:16,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:16,529 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,529 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 10:56:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:16,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36455,1678791214611' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 10:56:16,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c42441a[Count = 0] remaining members to acquire global barrier 2023-03-14 10:56:16,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 10:56:16,530 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,531 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 10:56:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 10:56:16,531 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,531 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 10:56:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36455,1678791214611' in zk 2023-03-14 10:56:16,533 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 10:56:16,533 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:16,533 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,533 DEBUG [member: 'jenkins-hbase4.apache.org,36455,1678791214611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36455,1678791214611': 2023-03-14 10:56:16,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36455,1678791214611' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 10:56:16,536 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 10:56:16,536 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 10:56:16,536 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 10:56:16,536 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 10:56:16,536 INFO [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 10:56:16,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 10:56:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 10:56:16,537 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:16,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 10:56:16,538 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 10:56:16,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,539 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 10:56:16,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 10:56:16,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 10:56:16,541 DEBUG [(jenkins-hbase4.apache.org,37569,1678791213358)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 10:56:16,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 10:56:16,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 10:56:16,541 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 10:56:16,542 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 10:56:16,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 10:56:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 10:56:16,542 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 10:56:16,542 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 10:56:16,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 10:56:16,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 10:56:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 10:56:16,642 DEBUG [Listener at localhost/44023] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 10:56:16,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 10:56:16,643 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:16,644 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 is initiating major compaction (all files) 2023-03-14 10:56:16,644 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:16,644 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:16,645 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 in testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:16,645 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp, totalSize=27.1 K 2023-03-14 10:56:16,645 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 4874b080fbb343349b01cf981f914a9b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368728 2023-03-14 10:56:16,646 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting cc09c3cea9044e3fa7d161a0c7037561, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370583 2023-03-14 10:56:16,646 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c9d08ffa628e42f4984a20e26d9a0bcd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:16,646 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting ff05789509414c1da0e9e94b2c92406a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:16,647 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 123a637d926a47fe8eb8f0f6d8cf6dd9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:16,661 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 5f056af8a677fcc6cb73d04f9b2cc0dd#family1#compaction#198 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:16,715 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del 2023-03-14 10:56:16,716 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del 2023-03-14 10:56:17,582 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 644c78a93b68423eaf4dcdb5bbff1d09 2023-03-14 10:56:17,583 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family1/644c78a93b68423eaf4dcdb5bbff1d09 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/644c78a93b68423eaf4dcdb5bbff1d09 2023-03-14 10:56:17,607 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 644c78a93b68423eaf4dcdb5bbff1d09 2023-03-14 10:56:17,608 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 of 5f056af8a677fcc6cb73d04f9b2cc0dd into 644c78a93b68423eaf4dcdb5bbff1d09(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:56:17,608 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:17,608 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:17,608 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 5f056af8a677fcc6cb73d04f9b2cc0dd/family2 is initiating major compaction (all files) 2023-03-14 10:56:17,608 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:17,608 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:17,610 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 5f056af8a677fcc6cb73d04f9b2cc0dd/family2 in testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:17,610 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp, totalSize=25.4 K 2023-03-14 10:56:17,611 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 32250ba9f6784ebda67c07b340d10dd5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368728 2023-03-14 10:56:17,611 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 2278db884c4f41cda80e63e0b6465489, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370583 2023-03-14 10:56:17,612 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 658aea422abe4fe49a5a3e35d7f62d60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:17,612 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a02e703be5624552a45e30370ee86067, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:17,612 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 97e75fe59ec34a75b05816aa31482b60, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:17,619 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 5f056af8a677fcc6cb73d04f9b2cc0dd#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:17,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9] to archive 2023-03-14 10:56:17,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:17,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/4874b080fbb343349b01cf981f914a9b 2023-03-14 10:56:17,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/cc09c3cea9044e3fa7d161a0c7037561 2023-03-14 10:56:17,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/c9d08ffa628e42f4984a20e26d9a0bcd 2023-03-14 10:56:17,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/ff05789509414c1da0e9e94b2c92406a 2023-03-14 10:56:17,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/123a637d926a47fe8eb8f0f6d8cf6dd9 2023-03-14 10:56:18,028 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314c16c3da4df274c7d967809ae623e60a5_del 2023-03-14 10:56:18,028 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314c16c3da4df274c7d967809ae623e60a5_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230314c16c3da4df274c7d967809ae623e60a5_del 2023-03-14 10:56:18,843 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e23ebce5817f4b54aebb324900b3d15c 2023-03-14 10:56:18,844 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/.tmp/family2/e23ebce5817f4b54aebb324900b3d15c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/e23ebce5817f4b54aebb324900b3d15c 2023-03-14 10:56:18,849 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e23ebce5817f4b54aebb324900b3d15c 2023-03-14 10:56:18,851 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f056af8a677fcc6cb73d04f9b2cc0dd/family2 of 5f056af8a677fcc6cb73d04f9b2cc0dd into e23ebce5817f4b54aebb324900b3d15c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:56:18,851 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:18,851 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:18,851 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 38d9722c1649f1b2cbaf2182ec144b45/family1 is initiating major compaction (all files) 2023-03-14 10:56:18,851 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:18,852 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:18,852 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 38d9722c1649f1b2cbaf2182ec144b45/family1 in testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:18,852 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp, totalSize=27.1 K 2023-03-14 10:56:18,852 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 00cbdb3f610548c4b95ac976838fba36, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368728 2023-03-14 10:56:18,853 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting dcf34ce5ab5e41adbe4a127903d5a088, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370584 2023-03-14 10:56:18,853 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 6067358f12c84072b8677a68c2a389b7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:18,854 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 9bf6d75534fb4f399cdfdf6199737cf1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:18,854 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 2a63208897304d149d320dce486e6bcd, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:18,865 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 38d9722c1649f1b2cbaf2182ec144b45#family1#compaction#200 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:18,918 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del 2023-03-14 10:56:18,918 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del 2023-03-14 10:56:18,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60] to archive 2023-03-14 10:56:18,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:18,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/32250ba9f6784ebda67c07b340d10dd5 2023-03-14 10:56:18,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/2278db884c4f41cda80e63e0b6465489 2023-03-14 10:56:18,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/658aea422abe4fe49a5a3e35d7f62d60 2023-03-14 10:56:18,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/a02e703be5624552a45e30370ee86067 2023-03-14 10:56:18,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family2/97e75fe59ec34a75b05816aa31482b60 2023-03-14 10:56:19,779 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d01f5b50dea4041b7a26fed8b1adaa6 2023-03-14 10:56:19,780 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family1/6d01f5b50dea4041b7a26fed8b1adaa6 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6d01f5b50dea4041b7a26fed8b1adaa6 2023-03-14 10:56:19,802 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d01f5b50dea4041b7a26fed8b1adaa6 2023-03-14 10:56:19,803 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38d9722c1649f1b2cbaf2182ec144b45/family1 of 38d9722c1649f1b2cbaf2182ec144b45 into 6d01f5b50dea4041b7a26fed8b1adaa6(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 10:56:19,803 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:19,803 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:19,803 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): 38d9722c1649f1b2cbaf2182ec144b45/family2 is initiating major compaction (all files) 2023-03-14 10:56:19,803 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:19,803 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:19,803 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of 38d9722c1649f1b2cbaf2182ec144b45/family2 in testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:19,803 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp, totalSize=25.4 K 2023-03-14 10:56:19,804 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 6e3db70ad7064fd1977ee7a54f1cddc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368728 2023-03-14 10:56:19,804 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 3e4aa2bed9454e4c902e88c066975638, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370584 2023-03-14 10:56:19,804 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 513a12bfb7204960a2462c37e43fb5cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:19,805 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c42baa2e92b44737a35d3433f8e4cc52, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:19,805 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a3e0306105e24003b1a068014acd7045, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:19,812 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): 38d9722c1649f1b2cbaf2182ec144b45#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:19,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd] to archive 2023-03-14 10:56:19,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:19,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/00cbdb3f610548c4b95ac976838fba36 2023-03-14 10:56:19,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/dcf34ce5ab5e41adbe4a127903d5a088 2023-03-14 10:56:19,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/6067358f12c84072b8677a68c2a389b7 2023-03-14 10:56:19,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/9bf6d75534fb4f399cdfdf6199737cf1 2023-03-14 10:56:19,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/2a63208897304d149d320dce486e6bcd 2023-03-14 10:56:20,218 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303146e143d8b025a4701b9490d5585e4a8ce_del 2023-03-14 10:56:20,219 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303146e143d8b025a4701b9490d5585e4a8ce_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303146e143d8b025a4701b9490d5585e4a8ce_del 2023-03-14 10:56:21,032 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60311065750e4c8fa74d49c82821194a 2023-03-14 10:56:21,032 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/.tmp/family2/60311065750e4c8fa74d49c82821194a as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/60311065750e4c8fa74d49c82821194a 2023-03-14 10:56:21,036 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60311065750e4c8fa74d49c82821194a 2023-03-14 10:56:21,037 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38d9722c1649f1b2cbaf2182ec144b45/family2 of 38d9722c1649f1b2cbaf2182ec144b45 into 60311065750e4c8fa74d49c82821194a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:56:21,037 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:21,037 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:21,037 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): f38e879bf9fc0af71ad43873a237e048/family1 is initiating major compaction (all files) 2023-03-14 10:56:21,037 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:21,037 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:21,037 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of f38e879bf9fc0af71ad43873a237e048/family1 in testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:21,037 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp, totalSize=27.1 K 2023-03-14 10:56:21,038 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 09d2f6a91c4644b385477778b56af6de, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368727 2023-03-14 10:56:21,038 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 48c02a03e5ae45bc863d4214a6c389f2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370583 2023-03-14 10:56:21,038 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 7ed96989fe014f83aecc190177fddc15, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:21,038 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 7cf2349fffcb48b5a606e4db125ad6b2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:21,039 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting c7cbd8d7c9f74671a0e85d0357212dd8, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:21,045 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): f38e879bf9fc0af71ad43873a237e048#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:21,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045] to archive 2023-03-14 10:56:21,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:21,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/6e3db70ad7064fd1977ee7a54f1cddc2 2023-03-14 10:56:21,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/3e4aa2bed9454e4c902e88c066975638 2023-03-14 10:56:21,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/513a12bfb7204960a2462c37e43fb5cc 2023-03-14 10:56:21,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/c42baa2e92b44737a35d3433f8e4cc52 2023-03-14 10:56:21,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family2/a3e0306105e24003b1a068014acd7045 2023-03-14 10:56:21,485 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del 2023-03-14 10:56:21,485 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del 2023-03-14 10:56:22,340 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12c239cf78994787a4186a3da7007fb5 2023-03-14 10:56:22,341 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family1/12c239cf78994787a4186a3da7007fb5 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/12c239cf78994787a4186a3da7007fb5 2023-03-14 10:56:22,365 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12c239cf78994787a4186a3da7007fb5 2023-03-14 10:56:22,366 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f38e879bf9fc0af71ad43873a237e048/family1 of f38e879bf9fc0af71ad43873a237e048 into 12c239cf78994787a4186a3da7007fb5(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:56:22,366 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:22,366 DEBUG [Listener at localhost/44023] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 10:56:22,366 DEBUG [Listener at localhost/44023] regionserver.HStore(1912): f38e879bf9fc0af71ad43873a237e048/family2 is initiating major compaction (all files) 2023-03-14 10:56:22,366 INFO [Listener at localhost/44023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 10:56:22,366 INFO [Listener at localhost/44023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 10:56:22,367 INFO [Listener at localhost/44023] regionserver.HRegion(2259): Starting compaction of f38e879bf9fc0af71ad43873a237e048/family2 in testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:22,367 INFO [Listener at localhost/44023] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d] into tmpdir=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp, totalSize=25.4 K 2023-03-14 10:56:22,367 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting e754376082e240f2a76a5152c38f715d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678791368727 2023-03-14 10:56:22,367 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 837d8029725749f4a609396ad2d6db5a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678791370583 2023-03-14 10:56:22,368 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 13aa324a8486444b9101ebf5887910d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678791372441 2023-03-14 10:56:22,368 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting 78eb5e0ba1954559a582c04c1840c1ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678791373927 2023-03-14 10:56:22,369 DEBUG [Listener at localhost/44023] compactions.Compactor(207): Compacting a703668212514bae90c2fddfcb0f390d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 10:56:22,379 INFO [Listener at localhost/44023] throttle.PressureAwareThroughputController(145): f38e879bf9fc0af71ad43873a237e048#family2#compaction#203 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 10:56:22,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8] to archive 2023-03-14 10:56:22,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:22,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/09d2f6a91c4644b385477778b56af6de 2023-03-14 10:56:22,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/48c02a03e5ae45bc863d4214a6c389f2 2023-03-14 10:56:22,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7ed96989fe014f83aecc190177fddc15 2023-03-14 10:56:22,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/7cf2349fffcb48b5a606e4db125ad6b2 2023-03-14 10:56:22,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/c7cbd8d7c9f74671a0e85d0357212dd8 2023-03-14 10:56:22,793 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314e92a33807b7647468589ae7ac84054a1_del 2023-03-14 10:56:22,793 INFO [Listener at localhost/44023] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314e92a33807b7647468589ae7ac84054a1_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230314e92a33807b7647468589ae7ac84054a1_del 2023-03-14 10:56:23,607 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6c6b2fb2cfe42eda605cd43ca133abf 2023-03-14 10:56:23,607 DEBUG [Listener at localhost/44023] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/.tmp/family2/a6c6b2fb2cfe42eda605cd43ca133abf as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a6c6b2fb2cfe42eda605cd43ca133abf 2023-03-14 10:56:23,611 INFO [Listener at localhost/44023] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6c6b2fb2cfe42eda605cd43ca133abf 2023-03-14 10:56:23,612 INFO [Listener at localhost/44023] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f38e879bf9fc0af71ad43873a237e048/family2 of f38e879bf9fc0af71ad43873a237e048 into a6c6b2fb2cfe42eda605cd43ca133abf(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 10:56:23,612 DEBUG [Listener at localhost/44023] regionserver.HRegion(2289): Compaction status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:23,615 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:23,618 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:23,624 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:23,625 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:23,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d] to archive 2023-03-14 10:56:23,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:23,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/e754376082e240f2a76a5152c38f715d 2023-03-14 10:56:23,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/837d8029725749f4a609396ad2d6db5a 2023-03-14 10:56:23,630 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37569] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xFA{\xD3\xE2\xFC\xF24h;\xFB}1\x117p\x7F"\x10\x91\x9A,\x1D7b\x0E\xF2\x8B\xF5k4>\x04\x13\xB3*\x10_\xBEx\x94\x02%>\xCB<\xE8h\x97\x1F\xFDN\xB22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-14 10:56:23,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/13aa324a8486444b9101ebf5887910d7 2023-03-14 10:56:23,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/78eb5e0ba1954559a582c04c1840c1ed 2023-03-14 10:56:23,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family2/a703668212514bae90c2fddfcb0f390d 2023-03-14 10:56:23,650 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 10:56:23,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 10:56:23,652 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 10:56:23,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:56:23,653 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678791983653 2023-03-14 10:56:23,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 10:56:23,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-14 10:56:24,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del 2023-03-14 10:56:24,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del 2023-03-14 10:56:24,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del 2023-03-14 10:56:24,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:24,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] zookeeper.ReadOnlyZKClient(139): Connect 0x5b61e117 to 127.0.0.1:58692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 10:56:24,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb4ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 10:56:24,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:24,933 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 10:56:25,017 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303140c42a55800d04d0d8df45fecfdbbf924 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303140c42a55800d04d0d8df45fecfdbbf924 2023-03-14 10:56:25,018 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:25,032 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 10:56:25,034 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35636, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 10:56:25,042 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 10:56:25,043 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43188, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 10:56:25,070 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/df4bef8043f94647b33be54ae285cdaf first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-14 10:56:25,070 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/df4bef8043f94647b33be54ae285cdaf}] 2023-03-14 10:56:25,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/df4bef8043f94647b33be54ae285cdaf for inclusion in f38e879bf9fc0af71ad43873a237e048/family1 2023-03-14 10:56:25,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-14 10:56:25,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 10:56:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/df4bef8043f94647b33be54ae285cdaf to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a37ca6anq7953khpshrspmhgl23hmd31g7lq078r658lmq7v9fhvsr7r7t69jndt/family1/df4bef8043f94647b33be54ae285cdaf 2023-03-14 10:56:25,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a37ca6anq7953khpshrspmhgl23hmd31g7lq078r658lmq7v9fhvsr7r7t69jndt/family1/df4bef8043f94647b33be54ae285cdaf as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/87b7de00fa13477bae625999c969e642_SeqId_28_ 2023-03-14 10:56:25,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a37ca6anq7953khpshrspmhgl23hmd31g7lq078r658lmq7v9fhvsr7r7t69jndt/family1/df4bef8043f94647b33be54ae285cdaf into f38e879bf9fc0af71ad43873a237e048/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/87b7de00fa13477bae625999c969e642_SeqId_28_ - updating store file list. 2023-03-14 10:56:25,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/87b7de00fa13477bae625999c969e642_SeqId_28_ into f38e879bf9fc0af71ad43873a237e048/family1 2023-03-14 10:56:25,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a37ca6anq7953khpshrspmhgl23hmd31g7lq078r658lmq7v9fhvsr7r7t69jndt/family1/df4bef8043f94647b33be54ae285cdaf into f38e879bf9fc0af71ad43873a237e048/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/family1/87b7de00fa13477bae625999c969e642_SeqId_28_) 2023-03-14 10:56:25,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a37ca6anq7953khpshrspmhgl23hmd31g7lq078r658lmq7v9fhvsr7r7t69jndt/family1/df4bef8043f94647b33be54ae285cdaf 2023-03-14 10:56:25,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:25,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:25,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314812294acfab04872a94a297693920dad to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314812294acfab04872a94a297693920dad 2023-03-14 10:56:25,126 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148b3d3ae999a44c13954c9d5d231de7e5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148b3d3ae999a44c13954c9d5d231de7e5 2023-03-14 10:56:25,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314d765a13ce47d41dab6b3958640e2afc2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314d765a13ce47d41dab6b3958640e2afc2 2023-03-14 10:56:25,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314f69da7998b0a489494f2c4c78a173268 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314f69da7998b0a489494f2c4c78a173268 2023-03-14 10:56:25,129 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 10:56:25,129 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 10:56:25,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:25,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:25,689 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303140f359242118541399a5a9e190eac1e17 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303140f359242118541399a5a9e190eac1e17 2023-03-14 10:56:25,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:25,739 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/86b888634b3e41a3abd24ed285e234f2 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-14 10:56:25,740 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/86b888634b3e41a3abd24ed285e234f2}] 2023-03-14 10:56:25,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/86b888634b3e41a3abd24ed285e234f2 for inclusion in 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 2023-03-14 10:56:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-14 10:56:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 10:56:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:25,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/86b888634b3e41a3abd24ed285e234f2 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__nrmvljr4a6cnooqnemfqtcjnlc6ve49d0dkf3tu2anf4p60veb7b9vr4hpa3mnai/family1/86b888634b3e41a3abd24ed285e234f2 2023-03-14 10:56:25,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__nrmvljr4a6cnooqnemfqtcjnlc6ve49d0dkf3tu2anf4p60veb7b9vr4hpa3mnai/family1/86b888634b3e41a3abd24ed285e234f2 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/b0249ace55a44adca3c2ee6e1aabc9bb_SeqId_28_ 2023-03-14 10:56:25,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__nrmvljr4a6cnooqnemfqtcjnlc6ve49d0dkf3tu2anf4p60veb7b9vr4hpa3mnai/family1/86b888634b3e41a3abd24ed285e234f2 into 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/b0249ace55a44adca3c2ee6e1aabc9bb_SeqId_28_ - updating store file list. 2023-03-14 10:56:25,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/b0249ace55a44adca3c2ee6e1aabc9bb_SeqId_28_ into 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 2023-03-14 10:56:25,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__nrmvljr4a6cnooqnemfqtcjnlc6ve49d0dkf3tu2anf4p60veb7b9vr4hpa3mnai/family1/86b888634b3e41a3abd24ed285e234f2 into 5f056af8a677fcc6cb73d04f9b2cc0dd/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/family1/b0249ace55a44adca3c2ee6e1aabc9bb_SeqId_28_) 2023-03-14 10:56:25,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__nrmvljr4a6cnooqnemfqtcjnlc6ve49d0dkf3tu2anf4p60veb7b9vr4hpa3mnai/family1/86b888634b3e41a3abd24ed285e234f2 2023-03-14 10:56:25,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:25,793 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:25,794 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303144b3fd318ae0e4ee890491e5f9efe3290 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303144b3fd318ae0e4ee890491e5f9efe3290 2023-03-14 10:56:25,795 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b82232255bce45e78b3f96d66f8d3563 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b82232255bce45e78b3f96d66f8d3563 2023-03-14 10:56:25,795 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b8d626492fc844af8e1b616258afbeea to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314b8d626492fc844af8e1b616258afbeea 2023-03-14 10:56:25,796 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314e571aed9d2654d22a52dda7f152e6151 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314e571aed9d2654d22a52dda7f152e6151 2023-03-14 10:56:25,796 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 10:56:25,796 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 10:56:25,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:25,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:26,144 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 10:56:26,365 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303142a6a3ad4dd1e4f919c93c741af00c0ea to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303142a6a3ad4dd1e4f919c93c741af00c0ea 2023-03-14 10:56:26,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:26,421 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/8e36d2fcb01f4e3082fe472883f53c3b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-14 10:56:26,423 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45., hostname=jenkins-hbase4.apache.org,36455,1678791214611, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/8e36d2fcb01f4e3082fe472883f53c3b}] 2023-03-14 10:56:26,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(763): Validating hfile at hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/8e36d2fcb01f4e3082fe472883f53c3b for inclusion in 38d9722c1649f1b2cbaf2182ec144b45/family1 2023-03-14 10:56:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-14 10:56:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 10:56:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegion(2446): Flush status journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:26,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/8e36d2fcb01f4e3082fe472883f53c3b to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a4dor91upiq5m03t56saaogi84nd9gb4cgnvgm91u8mtm48306omge58r48s1q35/family1/8e36d2fcb01f4e3082fe472883f53c3b 2023-03-14 10:56:26,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a4dor91upiq5m03t56saaogi84nd9gb4cgnvgm91u8mtm48306omge58r48s1q35/family1/8e36d2fcb01f4e3082fe472883f53c3b as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/bcb50cf12f134405a40ae7fa8992e2fd_SeqId_28_ 2023-03-14 10:56:26,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(849): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a4dor91upiq5m03t56saaogi84nd9gb4cgnvgm91u8mtm48306omge58r48s1q35/family1/8e36d2fcb01f4e3082fe472883f53c3b into 38d9722c1649f1b2cbaf2182ec144b45/family1 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/bcb50cf12f134405a40ae7fa8992e2fd_SeqId_28_ - updating store file list. 2023-03-14 10:56:26,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(882): Loaded HFile hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/bcb50cf12f134405a40ae7fa8992e2fd_SeqId_28_ into 38d9722c1649f1b2cbaf2182ec144b45/family1 2023-03-14 10:56:26,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.HStore(855): Successfully loaded hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a4dor91upiq5m03t56saaogi84nd9gb4cgnvgm91u8mtm48306omge58r48s1q35/family1/8e36d2fcb01f4e3082fe472883f53c3b into 38d9722c1649f1b2cbaf2182ec144b45/family1 (new location: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/family1/bcb50cf12f134405a40ae7fa8992e2fd_SeqId_28_) 2023-03-14 10:56:26,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36455] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/staging/jenkins__testMajorCompactionFromAdmin__a4dor91upiq5m03t56saaogi84nd9gb4cgnvgm91u8mtm48306omge58r48s1q35/family1/8e36d2fcb01f4e3082fe472883f53c3b 2023-03-14 10:56:26,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:26,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:26,496 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303140f71c1ac6b8a42db97ffd62401d2abbd to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303140f71c1ac6b8a42db97ffd62401d2abbd 2023-03-14 10:56:26,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303142068f34a5d584cbd9f6ff708a723c0de to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303142068f34a5d584cbd9f6ff708a723c0de 2023-03-14 10:56:26,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031421da0846f4f54ba082de0358125873f5 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031421da0846f4f54ba082de0358125873f5 2023-03-14 10:56:26,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031480c4c645d32447cd8e7aa2cf519efcc0 to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031480c4c645d32447cd8e7aa2cf519efcc0 2023-03-14 10:56:26,499 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 10:56:26,499 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 10:56:26,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:26,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 10:56:26,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 10:56:26,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del] 2023-03-14 10:56:26,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:26,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314c2689c78493649e1b9513369f8607a01_del 2023-03-14 10:56:26,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 10:56:26,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del] 2023-03-14 10:56:26,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:26,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303143a7b142ad426449799b981b4c180642d_del 2023-03-14 10:56:26,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 10:56:26,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del] 2023-03-14 10:56:26,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 10:56:26,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del to hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303148c92dc367d7242d28e44f7e2bd6348ff_del 2023-03-14 10:56:26,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 10:56:26,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1678791217668] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 10:56:26,506 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 10:56:26,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.8560 sec 2023-03-14 10:56:26,526 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:26,529 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:26,532 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 10:56:26,533 DEBUG [Listener at localhost/44023] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 10:56:26,539 INFO [Listener at localhost/44023] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 10:56:26,580 INFO [Listener at localhost/44023] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=247 (was 259), OpenFileDescriptor=641 (was 646), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 161), ProcessCount=169 (was 169), AvailableMemoryMB=2660 (was 2666) 2023-03-14 10:56:26,581 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47652242 to 127.0.0.1:58692 2023-03-14 10:56:26,581 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:26,581 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-14 10:56:26,582 INFO [Listener at localhost/44023] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:56:26,582 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5759ba4d to 127.0.0.1:58692 2023-03-14 10:56:26,582 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:26,582 DEBUG [Listener at localhost/44023] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-14 10:56:26,582 DEBUG [Listener at localhost/44023] util.JVMClusterUtil(257): Found active master hash=848934891, stopped=false 2023-03-14 10:56:26,582 INFO [Listener at localhost/44023] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:56:26,584 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-14 10:56:26,584 INFO [Listener at localhost/44023] procedure2.ProcedureExecutor(629): Stopping 2023-03-14 10:56:26,584 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-14 10:56:26,584 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:56:26,584 DEBUG [Listener at localhost/44023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04dc6a2d to 127.0.0.1:58692 2023-03-14 10:56:26,584 DEBUG [Listener at localhost/44023] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:26,584 INFO [Listener at localhost/44023] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36455,1678791214611' ***** 2023-03-14 10:56:26,585 INFO [Listener at localhost/44023] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-14 10:56:26,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 10:56:26,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 10:56:26,585 INFO [RS:0;jenkins-hbase4:36455] regionserver.HeapMemoryManager(220): Stopping 2023-03-14 10:56:26,585 INFO [RS:0;jenkins-hbase4:36455] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-14 10:56:26,585 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-14 10:56:26,585 INFO [RS:0;jenkins-hbase4:36455] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-14 10:56:26,585 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 5f056af8a677fcc6cb73d04f9b2cc0dd 2023-03-14 10:56:26,586 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 639896e65719e698ba00c8e74c2bb4e8 2023-03-14 10:56:26,586 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for cc8c0d8d794d34832e277dc0ec7d3101 2023-03-14 10:56:26,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f056af8a677fcc6cb73d04f9b2cc0dd, disabling compactions & flushes 2023-03-14 10:56:26,586 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 4330ab5c277432d16109867ee596c48d 2023-03-14 10:56:26,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:26,586 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 38d9722c1649f1b2cbaf2182ec144b45 2023-03-14 10:56:26,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:26,586 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 1576252b5b8296373a155035d76450f0 2023-03-14 10:56:26,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. after waiting 0 ms 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 0c42127be2a634116538df3e30bdeac5 2023-03-14 10:56:26,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for cb7afecf284eff99764fb7f04b890587 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 9edb0c0e65a6948211efc92a242984fd 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 9a765a00674054a4a810d05e0c621874 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for f38e879bf9fc0af71ad43873a237e048 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 092db5a7b358fa9c4c7ac039923503da 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for f7fb312194ae80d3a49902c6111928fc 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for d2d7726cca3a4702b5284f4d4c6730ac 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 52038bd8d7c0b7c72eff2e24f9c5a70d 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 26af9fe197a28ba1491482613ddc1516 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for fde00c7405357fc882bfdd228054e155 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 0b4d830d045ae17cad3dab593d3566f1 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 77adcadf2f1c695c5ad4e92d97a5ed5d 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for bd77aa6bd2a692fa7c5691f440172e99 2023-03-14 10:56:26,587 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:26,587 DEBUG [RS:0;jenkins-hbase4:36455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23865418 to 127.0.0.1:58692 2023-03-14 10:56:26,587 DEBUG [RS:0;jenkins-hbase4:36455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:26,588 INFO [RS:0;jenkins-hbase4:36455] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-14 10:56:26,588 INFO [RS:0;jenkins-hbase4:36455] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-14 10:56:26,588 INFO [RS:0;jenkins-hbase4:36455] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-14 10:56:26,588 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-14 10:56:26,588 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-14 10:56:26,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-14 10:56:26,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-14 10:56:26,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-14 10:56:26,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-14 10:56:26,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-14 10:56:26,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-14 10:56:26,589 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1505): Waiting on 092db5a7b358fa9c4c7ac039923503da, 0b4d830d045ae17cad3dab593d3566f1, 0c42127be2a634116538df3e30bdeac5, 1576252b5b8296373a155035d76450f0, 1588230740, 26af9fe197a28ba1491482613ddc1516, 38d9722c1649f1b2cbaf2182ec144b45, 4330ab5c277432d16109867ee596c48d, 52038bd8d7c0b7c72eff2e24f9c5a70d, 5f056af8a677fcc6cb73d04f9b2cc0dd, 639896e65719e698ba00c8e74c2bb4e8, 77adcadf2f1c695c5ad4e92d97a5ed5d, 9a765a00674054a4a810d05e0c621874, 9edb0c0e65a6948211efc92a242984fd, bd77aa6bd2a692fa7c5691f440172e99, cb7afecf284eff99764fb7f04b890587, cc8c0d8d794d34832e277dc0ec7d3101, d2d7726cca3a4702b5284f4d4c6730ac, f38e879bf9fc0af71ad43873a237e048, f7fb312194ae80d3a49902c6111928fc, fde00c7405357fc882bfdd228054e155 2023-03-14 10:56:26,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/5f056af8a677fcc6cb73d04f9b2cc0dd/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f056af8a677fcc6cb73d04f9b2cc0dd: 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678791366582.5f056af8a677fcc6cb73d04f9b2cc0dd. 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 639896e65719e698ba00c8e74c2bb4e8, disabling compactions & flushes 2023-03-14 10:56:26,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. after waiting 0 ms 2023-03-14 10:56:26,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:56:26,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/639896e65719e698ba00c8e74c2bb4e8/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-14 10:56:26,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 639896e65719e698ba00c8e74c2bb4e8: 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678791288579.639896e65719e698ba00c8e74c2bb4e8. 2023-03-14 10:56:26,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/info/42c5bbfbef80455096c4586c9fa38c6f 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc8c0d8d794d34832e277dc0ec7d3101, disabling compactions & flushes 2023-03-14 10:56:26,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. after waiting 0 ms 2023-03-14 10:56:26,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:56:26,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithMonthlyPolicy/cc8c0d8d794d34832e277dc0ec7d3101/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-14 10:56:26,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42c5bbfbef80455096c4586c9fa38c6f 2023-03-14 10:56:26,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc8c0d8d794d34832e277dc0ec7d3101: 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678791231060.cc8c0d8d794d34832e277dc0ec7d3101. 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4330ab5c277432d16109867ee596c48d, disabling compactions & flushes 2023-03-14 10:56:26,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. after waiting 0 ms 2023-03-14 10:56:26,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:56:26,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/4330ab5c277432d16109867ee596c48d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-14 10:56:26,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4330ab5c277432d16109867ee596c48d: 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678791254571.4330ab5c277432d16109867ee596c48d. 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 38d9722c1649f1b2cbaf2182ec144b45, disabling compactions & flushes 2023-03-14 10:56:26,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. after waiting 0 ms 2023-03-14 10:56:26,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:26,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/38d9722c1649f1b2cbaf2182ec144b45/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:26,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 38d9722c1649f1b2cbaf2182ec144b45: 2023-03-14 10:56:26,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678791366582.38d9722c1649f1b2cbaf2182ec144b45. 2023-03-14 10:56:26,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1576252b5b8296373a155035d76450f0, disabling compactions & flushes 2023-03-14 10:56:26,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:56:26,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:56:26,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. after waiting 0 ms 2023-03-14 10:56:26,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:56:26,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1576252b5b8296373a155035d76450f0 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-14 10:56:26,619 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-14 10:56:26,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/.tmp/info/1072da138d9a4c33a3bcc8c754601d02 2023-03-14 10:56:26,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/.tmp/info/1072da138d9a4c33a3bcc8c754601d02 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/info/1072da138d9a4c33a3bcc8c754601d02 2023-03-14 10:56:26,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/info/1072da138d9a4c33a3bcc8c754601d02, entries=3, sequenceid=7, filesize=4.8 K 2023-03-14 10:56:26,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 1576252b5b8296373a155035d76450f0 in 14ms, sequenceid=7, compaction requested=false 2023-03-14 10:56:26,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/namespace/1576252b5b8296373a155035d76450f0/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-14 10:56:26,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:56:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1576252b5b8296373a155035d76450f0: 2023-03-14 10:56:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678791216525.1576252b5b8296373a155035d76450f0. 2023-03-14 10:56:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c42127be2a634116538df3e30bdeac5, disabling compactions & flushes 2023-03-14 10:56:26,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:56:26,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:56:26,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. after waiting 0 ms 2023-03-14 10:56:26,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:56:26,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyPolicy/0c42127be2a634116538df3e30bdeac5/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 10:56:26,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c42127be2a634116538df3e30bdeac5: 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678791259578.0c42127be2a634116538df3e30bdeac5. 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb7afecf284eff99764fb7f04b890587, disabling compactions & flushes 2023-03-14 10:56:26,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. after waiting 0 ms 2023-03-14 10:56:26,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:56:26,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/cb7afecf284eff99764fb7f04b890587/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 10:56:26,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb7afecf284eff99764fb7f04b890587: 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678791308558.cb7afecf284eff99764fb7f04b890587. 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9edb0c0e65a6948211efc92a242984fd, disabling compactions & flushes 2023-03-14 10:56:26,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. after waiting 0 ms 2023-03-14 10:56:26,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:56:26,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9edb0c0e65a6948211efc92a242984fd/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-14 10:56:26,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9edb0c0e65a6948211efc92a242984fd: 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678791254571.9edb0c0e65a6948211efc92a242984fd. 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a765a00674054a4a810d05e0c621874, disabling compactions & flushes 2023-03-14 10:56:26,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. after waiting 0 ms 2023-03-14 10:56:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:56:26,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testScannerOnBulkLoadRefHFiles/9a765a00674054a4a810d05e0c621874/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-14 10:56:26,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:56:26,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a765a00674054a4a810d05e0c621874: 2023-03-14 10:56:26,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678791254571.9a765a00674054a4a810d05e0c621874. 2023-03-14 10:56:26,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f38e879bf9fc0af71ad43873a237e048, disabling compactions & flushes 2023-03-14 10:56:26,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:26,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:26,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. after waiting 0 ms 2023-03-14 10:56:26,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:26,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionFromAdmin/f38e879bf9fc0af71ad43873a237e048/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f38e879bf9fc0af71ad43873a237e048: 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678791366582.f38e879bf9fc0af71ad43873a237e048. 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 092db5a7b358fa9c4c7ac039923503da, disabling compactions & flushes 2023-03-14 10:56:26,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. after waiting 0 ms 2023-03-14 10:56:26,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:56:26,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/092db5a7b358fa9c4c7ac039923503da/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:56:26,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 092db5a7b358fa9c4c7ac039923503da: 2023-03-14 10:56:26,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678791334533.092db5a7b358fa9c4c7ac039923503da. 2023-03-14 10:56:26,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7fb312194ae80d3a49902c6111928fc, disabling compactions & flushes 2023-03-14 10:56:26,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:56:26,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:56:26,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. after waiting 0 ms 2023-03-14 10:56:26,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:56:26,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/f7fb312194ae80d3a49902c6111928fc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 10:56:26,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7fb312194ae80d3a49902c6111928fc: 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678791308558.f7fb312194ae80d3a49902c6111928fc. 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2d7726cca3a4702b5284f4d4c6730ac, disabling compactions & flushes 2023-03-14 10:56:26,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. after waiting 0 ms 2023-03-14 10:56:26,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:56:26,672 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testCompactionWithHFileLink/d2d7726cca3a4702b5284f4d4c6730ac/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 10:56:26,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2d7726cca3a4702b5284f4d4c6730ac: 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678791308558.d2d7726cca3a4702b5284f4d4c6730ac. 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52038bd8d7c0b7c72eff2e24f9c5a70d, disabling compactions & flushes 2023-03-14 10:56:26,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. after waiting 0 ms 2023-03-14 10:56:26,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:56:26,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/52038bd8d7c0b7c72eff2e24f9c5a70d/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-14 10:56:26,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52038bd8d7c0b7c72eff2e24f9c5a70d: 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678791272877.52038bd8d7c0b7c72eff2e24f9c5a70d. 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26af9fe197a28ba1491482613ddc1516, disabling compactions & flushes 2023-03-14 10:56:26,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. after waiting 0 ms 2023-03-14 10:56:26,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:26,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithMonthlyPolicy/26af9fe197a28ba1491482613ddc1516/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-14 10:56:26,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26af9fe197a28ba1491482613ddc1516: 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678791353195.26af9fe197a28ba1491482613ddc1516. 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fde00c7405357fc882bfdd228054e155, disabling compactions & flushes 2023-03-14 10:56:26,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. after waiting 0 ms 2023-03-14 10:56:26,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:56:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/fde00c7405357fc882bfdd228054e155/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fde00c7405357fc882bfdd228054e155: 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678791334533.fde00c7405357fc882bfdd228054e155. 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b4d830d045ae17cad3dab593d3566f1, disabling compactions & flushes 2023-03-14 10:56:26,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. after waiting 0 ms 2023-03-14 10:56:26,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMinorCompactionWithWeeklyPolicy/0b4d830d045ae17cad3dab593d3566f1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 10:56:26,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b4d830d045ae17cad3dab593d3566f1: 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678791243517.0b4d830d045ae17cad3dab593d3566f1. 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77adcadf2f1c695c5ad4e92d97a5ed5d, disabling compactions & flushes 2023-03-14 10:56:26,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. after waiting 0 ms 2023-03-14 10:56:26,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:56:26,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/77adcadf2f1c695c5ad4e92d97a5ed5d/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-14 10:56:26,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:56:26,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77adcadf2f1c695c5ad4e92d97a5ed5d: 2023-03-14 10:56:26,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678791217872.77adcadf2f1c695c5ad4e92d97a5ed5d. 2023-03-14 10:56:26,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd77aa6bd2a692fa7c5691f440172e99, disabling compactions & flushes 2023-03-14 10:56:26,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:56:26,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:56:26,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. after waiting 0 ms 2023-03-14 10:56:26,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:56:26,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/ns/testMinorCompaction/bd77aa6bd2a692fa7c5691f440172e99/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 10:56:26,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:56:26,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd77aa6bd2a692fa7c5691f440172e99: 2023-03-14 10:56:26,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678791334533.bd77aa6bd2a692fa7c5691f440172e99. 2023-03-14 10:56:26,789 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 10:56:26,964 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-14 10:56:26,964 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-14 10:56:26,989 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 10:56:27,012 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/rep_barrier/48386afad6824c9187db6b99a1100d0c 2023-03-14 10:56:27,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48386afad6824c9187db6b99a1100d0c 2023-03-14 10:56:27,190 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 10:56:27,390 DEBUG [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 10:56:27,404 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 10:56:27,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/table/2df7147fe8604116a50d294f47b764c4 2023-03-14 10:56:27,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2df7147fe8604116a50d294f47b764c4 2023-03-14 10:56:27,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/info/42c5bbfbef80455096c4586c9fa38c6f as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/info/42c5bbfbef80455096c4586c9fa38c6f 2023-03-14 10:56:27,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42c5bbfbef80455096c4586c9fa38c6f 2023-03-14 10:56:27,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/info/42c5bbfbef80455096c4586c9fa38c6f, entries=226, sequenceid=130, filesize=37.9 K 2023-03-14 10:56:27,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/rep_barrier/48386afad6824c9187db6b99a1100d0c as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/rep_barrier/48386afad6824c9187db6b99a1100d0c 2023-03-14 10:56:27,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48386afad6824c9187db6b99a1100d0c 2023-03-14 10:56:27,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/rep_barrier/48386afad6824c9187db6b99a1100d0c, entries=1, sequenceid=130, filesize=5.0 K 2023-03-14 10:56:27,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/.tmp/table/2df7147fe8604116a50d294f47b764c4 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/table/2df7147fe8604116a50d294f47b764c4 2023-03-14 10:56:27,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2df7147fe8604116a50d294f47b764c4 2023-03-14 10:56:27,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/table/2df7147fe8604116a50d294f47b764c4, entries=27, sequenceid=130, filesize=6.6 K 2023-03-14 10:56:27,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 856ms, sequenceid=130, compaction requested=false 2023-03-14 10:56:27,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-14 10:56:27,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-14 10:56:27,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-14 10:56:27,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-14 10:56:27,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-14 10:56:27,590 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36455,1678791214611; all regions closed. 2023-03-14 10:56:27,596 DEBUG [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/oldWALs 2023-03-14 10:56:27,596 INFO [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36455%2C1678791214611.meta:.meta(num 1678791216229) 2023-03-14 10:56:27,600 DEBUG [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/oldWALs 2023-03-14 10:56:27,600 INFO [RS:0;jenkins-hbase4:36455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36455%2C1678791214611:(num 1678791216092) 2023-03-14 10:56:27,600 DEBUG [RS:0;jenkins-hbase4:36455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:27,600 INFO [RS:0;jenkins-hbase4:36455] regionserver.LeaseManager(133): Closed leases 2023-03-14 10:56:27,600 INFO [RS:0;jenkins-hbase4:36455] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-14 10:56:27,600 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-14 10:56:27,601 INFO [RS:0;jenkins-hbase4:36455] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36455 2023-03-14 10:56:27,609 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 10:56:27,609 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36455,1678791214611 2023-03-14 10:56:27,609 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d47339d rejected from java.util.concurrent.ThreadPoolExecutor@7978a8ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,609 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 10:56:27,609 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4993999f rejected from java.util.concurrent.ThreadPoolExecutor@7978a8ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,610 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36455,1678791214611] 2023-03-14 10:56:27,610 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36455,1678791214611; numProcessing=1 2023-03-14 10:56:27,613 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36455,1678791214611 already deleted, retry=false 2023-03-14 10:56:27,613 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36455,1678791214611 expired; onlineServers=0 2023-03-14 10:56:27,613 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37569,1678791213358' ***** 2023-03-14 10:56:27,613 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-14 10:56:27,613 DEBUG [M:0;jenkins-hbase4:37569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73a4bdd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-14 10:56:27,613 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37569,1678791213358 2023-03-14 10:56:27,613 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37569,1678791213358; all regions closed. 2023-03-14 10:56:27,613 DEBUG [M:0;jenkins-hbase4:37569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:27,613 DEBUG [M:0;jenkins-hbase4:37569] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-14 10:56:27,614 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-14 10:56:27,614 DEBUG [M:0;jenkins-hbase4:37569] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-14 10:56:27,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678791215744] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1678791215744,5,FailOnTimeoutGroup] 2023-03-14 10:56:27,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678791215744] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1678791215744,5,FailOnTimeoutGroup] 2023-03-14 10:56:27,614 INFO [M:0;jenkins-hbase4:37569] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-14 10:56:27,614 INFO [M:0;jenkins-hbase4:37569] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-14 10:56:27,614 INFO [M:0;jenkins-hbase4:37569] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-14 10:56:27,614 DEBUG [M:0;jenkins-hbase4:37569] master.HMaster(1512): Stopping service threads 2023-03-14 10:56:27,615 INFO [M:0;jenkins-hbase4:37569] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-14 10:56:27,615 ERROR [M:0;jenkins-hbase4:37569] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-14 10:56:27,616 INFO [M:0;jenkins-hbase4:37569] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-14 10:56:27,616 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-14 10:56:27,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-14 10:56:27,620 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 10:56:27,620 DEBUG [M:0;jenkins-hbase4:37569] zookeeper.ZKUtil(398): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-14 10:56:27,620 WARN [M:0;jenkins-hbase4:37569] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-14 10:56:27,620 INFO [M:0;jenkins-hbase4:37569] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-14 10:56:27,620 INFO [M:0;jenkins-hbase4:37569] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-14 10:56:27,620 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-14 10:56:27,621 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:56:27,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 10:56:27,621 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:56:27,621 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-14 10:56:27,621 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:56:27,621 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.86 KB heapSize=598.63 KB 2023-03-14 10:56:27,634 INFO [M:0;jenkins-hbase4:37569] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.86 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9c830d5e87bc4847aebc0450b1f7b692 2023-03-14 10:56:27,638 INFO [M:0;jenkins-hbase4:37569] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c830d5e87bc4847aebc0450b1f7b692 2023-03-14 10:56:27,638 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9c830d5e87bc4847aebc0450b1f7b692 as hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9c830d5e87bc4847aebc0450b1f7b692 2023-03-14 10:56:27,642 INFO [M:0;jenkins-hbase4:37569] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c830d5e87bc4847aebc0450b1f7b692 2023-03-14 10:56:27,642 INFO [M:0;jenkins-hbase4:37569] regionserver.HStore(1080): Added hdfs://localhost:40011/user/jenkins/test-data/c8dfcb50-5073-5710-c4de-022d8fff245b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9c830d5e87bc4847aebc0450b1f7b692, entries=123, sequenceid=1006, filesize=33.3 K 2023-03-14 10:56:27,643 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegion(2948): Finished flush of dataSize ~512.86 KB/525173, heapSize ~598.61 KB/612976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=1006, compaction requested=false 2023-03-14 10:56:27,643 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 10:56:27,643 DEBUG [M:0;jenkins-hbase4:37569] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 10:56:27,646 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-14 10:56:27,646 INFO [M:0;jenkins-hbase4:37569] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-14 10:56:27,647 INFO [M:0;jenkins-hbase4:37569] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37569 2023-03-14 10:56:27,650 DEBUG [M:0;jenkins-hbase4:37569] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37569,1678791213358 already deleted, retry=false 2023-03-14 10:56:27,711 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 10:56:27,711 INFO [RS:0;jenkins-hbase4:36455] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36455,1678791214611; zookeeper connection closed. 2023-03-14 10:56:27,711 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@318f7e77 rejected from java.util.concurrent.ThreadPoolExecutor@7978a8ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,711 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): regionserver:36455-0x100e2a8e7a50001, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 10:56:27,711 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@95ff39d rejected from java.util.concurrent.ThreadPoolExecutor@7978a8ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,711 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@26a73405] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@26a73405 2023-03-14 10:56:27,711 INFO [Listener at localhost/44023] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-14 10:56:27,811 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 10:56:27,811 INFO [M:0;jenkins-hbase4:37569] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37569,1678791213358; zookeeper connection closed. 2023-03-14 10:56:27,811 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@245988a3 rejected from java.util.concurrent.ThreadPoolExecutor@57efd19e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,811 DEBUG [Listener at localhost/44023-EventThread] zookeeper.ZKWatcher(600): master:37569-0x100e2a8e7a50000, quorum=127.0.0.1:58692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 10:56:27,811 ERROR [Listener at localhost/44023-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d55da24 rejected from java.util.concurrent.ThreadPoolExecutor@57efd19e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 10:56:27,813 WARN [Listener at localhost/44023] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-14 10:56:27,815 INFO [Listener at localhost/44023] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-14 10:56:27,923 WARN [BP-2076555910-172.31.14.131-1678791209982 heartbeating to localhost/127.0.0.1:40011] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-14 10:56:27,923 WARN [BP-2076555910-172.31.14.131-1678791209982 heartbeating to localhost/127.0.0.1:40011] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2076555910-172.31.14.131-1678791209982 (Datanode Uuid eb09e7eb-30a0-480d-ad70-3fa28c74f7ed) service to localhost/127.0.0.1:40011 2023-03-14 10:56:27,925 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/dfs/data/data1/current/BP-2076555910-172.31.14.131-1678791209982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-14 10:56:27,926 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/6d4133bf-eb6b-f131-e4a2-b2a91149f4ef/cluster_9640051f-e57c-ef57-4f18-b22be6590ef8/dfs/data/data2/current/BP-2076555910-172.31.14.131-1678791209982] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-14 10:56:27,960 INFO [Listener at localhost/44023] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-14 10:56:28,085 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 10:56:28,085 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b61e117 to 127.0.0.1:58692 2023-03-14 10:56:28,085 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 10:56:28,107 INFO [Listener at localhost/44023] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-14 10:56:28,186 INFO [Listener at localhost/44023] hbase.HBaseTestingUtility(1293): Minicluster is down